: Scrape Intranet Website I have a personal weather station connected to my LAN that provides its info (e.g. temperature, rainfall, humidity) via a web UI. I would like to scrape this info so

I have a personal weather station connected to my LAN that provides its info (e.g. temperature, rainfall, humidity) via a web UI. I would like to scrape this info so I can make a better webpage of my own, and keep a record of the daily weather in a spreadsheet.

I know there are scrapers like parsehub and import.io, but they seem to work off the cloud which means they cannot access the websites residing locally on my home network.

What are some of the best ways to scrape content off a local website on a regular basis?

10.01% popularity Vote Up Vote Down

: SEO. Redirecting a website to my own website I manage a website www.example.com. I have found another website called www.example2.com. I want to talk and merge it with my own completely, so

@Speyer207

Posted in: #301Redirect #302Redirect #Google #Redirects #Seo

1 Comments

: Website restructuring, 301 redirect or complete de-index? I am managing an e-store site created by another colleague, that was badly created from the start. Because of the structure, pagination

@Speyer207

Posted in: #301Redirect #Indexing #Redirects

2 Comments

: What happens if CSS file falls out of cache but HTML file doesn't? I have a static HTML page for which I have set a cache-control max-age of 6 months, and it calls a style_v1.css file with

@Speyer207

Posted in: #Cache #CacheControl

2 Comments

: How to setup MX records on a shared application serving multiple domains? We are in the process of transitioning from 150 separate websites on individual domains to 150 domains all served by

@Speyer207

Posted in: #Dns #Email #MultipleDomains

1 Comments

Login to post a comment!

1 Comments

Sorted by latest first Latest Oldest Best

@Bryan171

if your site is available with browser, than it is scrapeable on regular basis, because it has a regular internet address, like an IP-address.

Your task seems to me to be pretty simple:

open the web UI of the weather station and
recognize XPath of a site element(s), which you want to scrape. Use Chrome dev.tools->right click->copyXPath
scrape them into Google Spreadsheats and =importXML()

how to scrape with =importxml & Gspreadsheats

10% popularity Vote Up Vote Down

Feed

: Scrape Intranet Website I have a personal weather station connected to my LAN that provides its info (e.g. temperature, rainfall, humidity) via a web UI. I would like to scrape this info so

More posts by @Speyer207

: SEO. Redirecting a website to my own website I manage a website www.example.com. I have found another website called www.example2.com. I want to talk and merge it with my own completely, so

: Website restructuring, 301 redirect or complete de-index? I am managing an e-store site created by another colleague, that was badly created from the start. Because of the structure, pagination

: What happens if CSS file falls out of cache but HTML file doesn't? I have a static HTML page for which I have set a cache-control max-age of 6 months, and it calls a style_v1.css file with

: How to setup MX records on a shared application serving multiple domains? We are in the process of transitioning from 150 separate websites on individual domains to 150 domains all served by

Login to post a comment!

1 Comments

Back to top | Use Dark Theme