You are browsing on some websites and you see an interesting information, that you want to poll to be used into your system.
Unfortunately, you don’t know the website provider, and you don’t know if a “plug” is provided, for instance a WebService.
So you have to find a way to get the information.
You can create a Camel route looking like:
Here, every 2 seconds, we access to blog.nanthrax.net to get the HTML source. We can eventually provide some parameters (with POST method here).
On this HTML, we use tidy markup (from camel-tagsoup component) to cleanup the HTML code and format it in XML.
After that, we extract from the source, only the content of element.
Finally, we send the filtered content into the log.