MLabs
Web Scraping Specialist
RemoteUnited States onlyArchived
- Role
- Backend
- Employment
- Full-time
$75k–$100k/yr
Check eligibility
Open to US only. Set where you work from to check your eligibility.
No BS summary
Web Scraping Specialist to build infrastructure delivering massive web data for AI model training. Advanced Python or JavaScript with BeautifulSoup, Scrapy, or Selenium; async programming, multithreading, distributed scraping. Remote with 6-hour EST overlap, $75K-$100K.
Core skills
Web Scraping
Required skills
Python/JavaScriptBeautifulSoup/Scrapy/SeleniumAsynchronous programmingMultithreadingDistributed scrapingHTMLCSSDOMMongoDBCassandraNoSQLAWSGCPAzure
Optional skills
Machine Learning
What you'll do
- Write, test, and refine high-performance code to extract data from various online sources
- Manage complex data retrieval tasks, including handling pagination and dynamic content loaded via AJAX
- Clean and format extracted data to ensure it meets rigorous quality standards for downstream analysis and processing
- Store and manage scraped data in appropriate databases, optimizing for both access speed and long-term data integrity
- Regularly monitor scraping processes and infrastructure to identify and resolve issues, ensuring a continuous and stable data flow
What they require
- Demonstrated ability to extract data from complex websites with minimal supervision, supported by a portfolio of past projects
- Advanced skills in Python or JavaScript
- Strong knowledge of asynchronous programming, multithreading, and distributed scraping architectures
- In-depth knowledge of HTML, CSS, JavaScript, and the Document Object Model (DOM)
- Experience with NoSQL databases (e.g., MongoDB, Cassandra)
- Experience deploying and managing large-scale scraping jobs using cloud services such as AWS, Google Cloud, or Azure
Benefits
- Highly competitive salary ranging from $75,000 to $100,000, complemented by a comprehensive benefits and equity package
- Opportunity to work at the forefront of AI development and web-scale knowledge graph creation
- Professional environment that prioritizes low ego, technical autonomy, and rapid execution
- Remote flexibility with 6-hour overlap with the core team's schedule
MLabs' client operates a core banking platform for digital assets, enabling fintechs and financial institutions to build, operate, and scale onchain infrastructure. The platform secures over €100B in assets and powers key management, transaction processing, treasury, and compliance for over 400 global institutions.
$75k–$100k/yr