MLabs
Web Scraping Specialist
УдалённоUnited States толькоВ архиве
- Роль
- Бэкенд
- Занятость
- Полная занятость
$75k–$100k/yr
Проверьте доступность
Доступно для: US only. Укажите, откуда вы работаете, чтобы проверить доступность.
Коротко по делу
Web Scraping Specialist to build infrastructure delivering massive web data for AI model training. Advanced Python or JavaScript with BeautifulSoup, Scrapy, or Selenium; async programming, multithreading, distributed scraping. Remote with 6-hour EST overlap, $75K-$100K.
Ключевые навыки
Web Scraping
Обязательные навыки
Python/JavaScriptBeautifulSoup/Scrapy/SeleniumAsynchronous programmingMultithreadingDistributed scrapingHTMLCSSDOMMongoDBCassandraNoSQLAWSGCPAzure
Желательные навыки
Machine Learning
Чем предстоит заниматься
- Write, test, and refine high-performance code to extract data from various online sources
- Manage complex data retrieval tasks, including handling pagination and dynamic content loaded via AJAX
- Clean and format extracted data to ensure it meets rigorous quality standards for downstream analysis and processing
- Store and manage scraped data in appropriate databases, optimizing for both access speed and long-term data integrity
- Regularly monitor scraping processes and infrastructure to identify and resolve issues, ensuring a continuous and stable data flow
Что требуется
- Demonstrated ability to extract data from complex websites with minimal supervision, supported by a portfolio of past projects
- Advanced skills in Python or JavaScript
- Strong knowledge of asynchronous programming, multithreading, and distributed scraping architectures
- In-depth knowledge of HTML, CSS, JavaScript, and the Document Object Model (DOM)
- Experience with NoSQL databases (e.g., MongoDB, Cassandra)
- Experience deploying and managing large-scale scraping jobs using cloud services such as AWS, Google Cloud, or Azure
Преимущества
- Highly competitive salary ranging from $75,000 to $100,000, complemented by a comprehensive benefits and equity package
- Opportunity to work at the forefront of AI development and web-scale knowledge graph creation
- Professional environment that prioritizes low ego, technical autonomy, and rapid execution
- Remote flexibility with 6-hour overlap with the core team's schedule
MLabs' client operates a core banking platform for digital assets, enabling fintechs and financial institutions to build, operate, and scale onchain infrastructure. The platform secures over €100B in assets and powers key management, transaction processing, treasury, and compliance for over 400 global institutions.
$75k–$100k/yr