Earlier I wrote that I would include an article for actually getting the data from a web site using mechanisms such as WebClient, HttpWebClient etc.

Someone beat me to the punch, go to this well written article in code project. He presents using ScrapySharp. Although I don't have much experience with this product, it looks worth exploring. The article shows how I would use Fidler to examine the requests going back and forth and what needs to be sent as parameters etc.

http://www.codeproject.com/Articles/1041115/Webscraping-with-Csharp

Steve

Comments

Post a Comment

Popular posts from this blog

Working with DocuSign

Image
A Starting point Recently my customer made the business decision to streamline their contracting process. Currently a sales agent will create a set of documents which will be downloaded, printed and signed off by the prospect. Once the prospect signs the contract, it is faxed back and countersigned. After countersigning, the document would be scanned and saved for reference. After much due diligence, my customer decided to go with a solution provided by DocuSign. It provides the ability to send documents to recipients for their viewing and / or approval. Background I was tasked with incorporating this solution using a set of APIs provided by DocuSign. The API calls are provided as both SOAP and Rest implementations and feature an extensive array of documentation and tools to help with implementation. I made the decision to go forward with the Rest implementation because of the ease of implementation and configuration. DocuSign provides an API Explorer allowing you the oppor
Read more

Getting the CycleGear Bilt Techno 2.0 with Sena DWO-5 headset to work with Sena's Driver software.

Image
UPDATE - 9/26/2017 the following announcement was on the Sena Forum: A new version of the Cycle Gear Bluetooth Device Manager has been uploaded to the website. This will allow you to update the firmware for the DWO-5. I have confirmed that the software installs correctly AND that is includes the FTD2XX.DLL which was missing from their last version. In addition to programming as a profession, I really like to ride motorcycles. Recently I bought myself a really nice Bilt Techno 2.0 modular helmet from CycleGear. They have two local shops in the Chicago area and really do a nice job helping you to select the appropriate gear. This helmet includes a Bluetooth radio DWO-5 supplied by Sena. Out of the box everything worked well. Being the tech type of guy I am, I wanted to try the "Device Manager" software which updates the firmware and allows you to set the speed dial numbers. This is my experience getting this to actually work and the poor support I got from Sena's te
Read more

A new posting to CodeProject.

 So it's been awhile. Still working with Polaris Solution working from home like most of us lately. Today I released a small project using CodeProject's Import GitHub project. Those guys at CodeProject have done a great job to connect to and reduce the friction between themselves, In the past I would write an article on CodeProject, upload images and insert codesnippets. Now all this can be done with the Readme.md file in GitHub. Additionally, the latest files are always kept in sync with GitHib and the files no longer need to be uploaded separately.  The project allows you to visualize more easily the dependencies between database objects. See how a stored procedure connects to a table, view etc. See the table definition as well as procedures, triggers and views.  Here is the link on CodeProject : and on GitHub :
Read more