How I scraped the CQC Care Register without hitting the API auth wall
The article discusses how to scrape the CQC Care Register data without facing authentication issues. The author outlines the challenges encountered with the CQC's new API and the solution of using a publicly available open-data file. By parsing the data from this file, the author created a scraper that efficiently retrieves and processes the information needed.
- ▪The Care Quality Commission regulates over 56,000 healthcare and social care locations in England.
- ▪The CQC's new API requires bearer token authentication, creating barriers for data access.
- ▪The author utilized a monthly open-data file published by CQC to scrape the necessary information without authentication.
Opening excerpt (first ~120 words) tap to expand
try { if(localStorage) { let currentUser = localStorage.getItem('current_user'); if (currentUser) { currentUser = JSON.parse(currentUser); if (currentUser.id === 3954791) { document.getElementById('article-show-container').classList.add('current-user-is-article-author'); } } } } catch (e) { console.error(e); } Daniel Ainsworth Posted on May 28 How I scraped the CQC Care Register without hitting the API auth wall #javascript #typescript #node #webdev The Care Quality Commission regulates 56,000+ healthcare and social care locations in England — care homes, GP surgeries, hospitals, dental practices, home care agencies. If you work in care sector tech, you've probably needed this data at some point. There's a CQC REST API, and I was planning to wrap it. Then I hit the auth wall.
…
Excerpt limited to ~120 words for fair-use compliance. The full article is at DEV.to (Top).
Discussion
0 commentsMore from DEV.to (Top)
