Join Menlo Ventures as a Senior Software Engineer to lead the Data Acquisition team in building a large-scale web crawler and enhancing data ingestion processes. You'll work in a collaborative environment focused on ethical AI systems and impactful research.
Key Responsibilities
Develop and maintain an internet scale web crawler
Build pipelines for data ingestion, analysis, and quality improvement
Collaborate with team members on improving data acquisition processes
Develop specialized crawlers for high-value data sources
Required Qualifications
5+ years of experience with building and running large distributed systems
Bachelor's degree in a related field or equivalent experience
Familiarity with Python
Understanding of data privacy issues and internet-scale crawling tradeoffs
Preferred Qualifications
Familiarity with Cloud-based compute and storage solutions
Quick understanding of systems design tradeoffs
Benefits & Perks
Competitive compensationGenerous vacation and parental leaveFlexible working hoursOptional equity donation matchingCollaborative office space