Tracking Web Pages with Intelligent Spiders — The Hub Page Monitoring

London, United Kingdom, December 21, 2016 --(PR.com)-- The Internet is a goldmine of data, but there are a very few easy ways to extract and organise that data in a structured way. It is not easy to rummage through the financial information of all tech companies on the stock market or explore a potential relationship between commodity prices and derivatives using existing options. Either the setup is tedious, or a customised solution is needed to manage the complexity of variants.

Introducing “Page Monitoring” from The Hub, a technology that enables both developers and non-tech users alike to easily create APIs out of websites, thereby making data easy to extract, organise and play. An API (application program interface) is a way of sharing data between two interfaces, in this case, the data that is trapped within websites can be extracted using intelligent snippets of code. Page discovery can be controlled with custom Spiders.

API data feeds can be split into sections from a site which the user chooses during configuration. The Spiders are set on a schedule to periodically revisit those sites and extract any new data that has been updated. After it retrieves the data and structures it, the encrypted API forwards it into the destination of the user’s choosing. So if the government updates a policy on oil regulations, the user can be notified rather than waiting for it to appear on the news or needing to manually search through thousands of pages looking for changes.

The Spiders keep watching those websites, which means that the data remains fresh and reliable. Users can employ the Page Monitor service to grab data from multiple websites and store it anywhere they like: hard drives, the cloud or even as a datasource for a mobile app, without writing a single line of code.

Investor Juned Jable says, “The Hub Page Monitor not only replaces tedious processes of getting the right data but also opens up new channels of getting valuable data that might not have been possible otherwise. We are now able to build large databases/visualisations of high-interest topics including legal, finance and healthcare. It speeds up our ability to produce data more than ten times faster than existing methods.”

“We have also added a powerful search feature to filter through all the data that our system collects. Users can filter data by name, category, source, and other parameters to find relevant results. These spiders are entirely customisable and and a breeze to setup and deploy,” added another investor Jonathan Anthony.

Using page monitoring technology does not change users’ legal obligations to respect copyright, so which sites may be monitored and whether or not that information can be publicly redistributed depends on each site’s individual terms and conditions. The technology is primarily aimed at the regulatory sector where there is an obligation to monitor such information.

The Hub Page Monitor offers the ability to turn any website’s data into a structured API. With the price of structured data skyrocketing, The Hub Page Monitor will be a valuable tool in every organisation’s toolkit.

Learn more at www.thehub.ai