Data Engineer
- Employment
- Full-time
- Experience
- 4+ years
- English
- required
This role is for one of Weekday’s clients Salary range: Rs 1000000 - Rs 1500000 (ie INR 10 - 15 LPA)
- Min Experience: 4+ years
- Location: Pune, Bangalore
- JobType: full-time
We are looking for a skilled Data Engineer with hands-on experience in data engineering, web scraping, system integrations, and data migration. The role involves building automated data extraction solutions to retrieve information from healthcare vendor portals, transforming and validating the extracted data, and migrating it into target systems through REST APIs.
The ideal candidate should have strong Python or [link] programming skills, practical experience with browser automation tools, and the ability to build reusable, scalable data connectors. The candidate must also be comfortable interacting with US-based customers, managing multiple migrations under tight deadlines, and handling sensitive patient information in compliance with HIPAA requirements.
- Data Extraction and Web Scraping
- Design, develop, and maintain automated crawlers to access healthcare vendor portals such as WebPT, Prompt, Raintree, Clinicient, and Jane.
- Extract and retrieve structured information, including patient records, insurance details, appointments, provider information, documents, and account balances.
- Handle portal-specific challenges such as multi-factor authentication (MFA), session timeouts, pagination, rate limits, and frequent UI or layout changes.
- Build reliable browser a