python - Extracting website (URL) from Google local search when URL not found in source? -

-

i'm looking extract (with webdriver, xpath, css selector, class or id) url lives behind each of website images in google local search results page such this

enter image description here

when mouseover of these, can see url reached if click image. yet if view full page source , search of these urls, they're not found. @ source around 1 of images:

enter image description here

suggest urls perhaps read in dynamically, though knowledge of web design ends. possible construct xpath or css selector or indeed plain-text search these urls?

clarification: when url, mean ultimate urls. mouseover of website images , you'll see urls such bodinbalanceny.com, lamchiropractic.com etc. – these urls i'm looking extract.

you can use urlparse. once fetch href attribute, append "https://www.google.com" , try code below.

>>> import urlparse >>> url = """https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&uact=8&ved=0cbaqgu8wagovchmi6c6mhpvjyaivqyeuch0eiaai&url=http%3a%2f%2fwww.taihealthsolutions.com%2f&usg=afqjcnhhovnrx0zdxz1cu4p2xiueffczta&bvm=bv.105841590,d.dgo""" >>> parsed = urlparse.urlparse(url) >>> print urlparse.parse_qs(parsed.query)['url'][0] http://www.taihealthsolutions.com/

note: python 2.x. python 3, code different.


Comments

Post a Comment

Popular posts from this blog

javascript - Chart.js (Radar Chart) different scaleLineColor for each scaleLine -

-
Image
i try , create radar chart using chart.js has various colours each scaleline, or coloured between scalelines. wondering if possible? from: to: i have working graph, though there doesn't seem method change individual scale lines. kind regards leigh you can extend radar chart type this, so chart.types.radar.extend({ name: "radaralt", initialize: function (data) { chart.types.radar.prototype.initialize.apply(this, arguments); var originalscaledraw = this.scale.draw; var ctx = this.chart.ctx; this.scale.draw = function () { var linewidth = this.linewidth; // bypasses line drawing in originalscaledraw this.linewidth = linewidth; originalscaledraw.apply(this, arguments); ctx.linewidth = this.linewidth; var scale = this; // draw chart.helpers.each(scale.ylabels, function (label, index) { // color of ...
Read more

apache - Error with PHP mail(): Multiple or malformed newlines found in additional_header -

-
suddenly have started receiving above error without changes having been made script. host 1and1 (i know...) the script still works fine on different server, , suspicion there must have been server config change has lead this, although hosts plead ignorance. there's no information on above error @ in google can find - have ideas? server running apache if helps. had similar problem. came out of blue. no php code changed. what changed: php upgraded 5.5.25-1 5.5.26. a security risk in php mail() function has been fixed , newlines in additional_headers allowed no more. because newlines mean: starts email message (and surely don't want inject newlines through headers followed evil message). what have worked fine, e.g. having newlines after headers or passing whole message additional_headers , function no more. solution : sanitize headers. no multiple newlines in additional_headers argument. these count "multiple or malformed newlines":...
Read more

java - Android – MapFragment overlay button shadow, just like MyLocation button -

-
Image
i'm struggling add shadow custom overlay button on google map. goal make custom button google's mylocation button. here's how app looks now: layout.xml <relativelayout xmlns:android="http://schemas.android.com/apk/res/android" xmlns:tools="http://schemas.android.com/tools" xmlns:map="http://schemas.android.com/apk/res-auto" android:layout_height="match_parent" android:layout_width="match_parent" style="@style/apptheme"> <fragment android:layout_width="match_parent" android:layout_height="match_parent" android:id="@+id/map" tools:context=".mapsactivity" android:name="com.google.android.gms.maps.supportmapfragment" android:layout_alignparentend="true" android:layout_alignparentstart="true" android:layout_alignparentbottom="true" ...
Read more