Forage AI Careers!
Lead - Software Engineer - Platform / Backend (AWS, DevOps, Python)
Technology
Full Time
Remote
About Forage AI: Forage AI delivers large-scale data collection and processing platforms, including web crawlers, document parsers, data pipelines, AI/Agentic Solutions, and AI-assisted workflows.
Our primary programming language is Python. We design both cloud-native and cloud-agnostic solutions, primarily on AWS, while also working with GCP and Azure. We value high ownership, strong collaboration, and pragmatic, well-documented engineering.
Role Overview (Engineering Lead, Hands-on):
This is an Engineering Lead role with strong hands-on responsibilities. You will lead teams while actively contributing to development. This includes reviewing designs and pull requests, pairing with engineers on complex problems, and setting technical direction.
You are expected to stay deeply involved in architecture, development, and delivery, while also owning team execution, quality, and growth.
Key Responsibilities:
-
Own end-to-end delivery: requirements, scoping, design, implementation, testing, deployment, and operations. -
Architect scalable, fault-tolerant systems for crawling, parsing, enrichment, and data processing.
-
Write production Python and set standards via code reviews, design docs, and reference implementations.
-
Lead and grow engineers: mentorship, pairing on hard problems, raising engineering quality and delivery discipline.
-
Translate business/client needs into technical plans; manage risks and trade-offs.
-
Establish best practices: branching strategy, CI/CD, testing, security baselines, SLAs/SLOs, and incident/RCA processes.
-
Own AWS + DevOps execution: define release strategy, environment management, deployments/rollbacks, and production hygiene.
-
Infrastructure leadership: introduce/maintain Infrastructure-as-Code, enforce least-privilege IAM, networking patterns, secrets management, and cost controls.
-
Reliability leadership: drive observability (metrics/logs/traces), alerting, on-call readiness, and post-incident improvements.
Required Qualifications:
-
7–11 years software engineering experience, with proven team/project leadership end-to-end.
-
Expert Python; strong DS/Algo fundamentals, concurrency, and distributed systems.
-
Strong SQL + NoSQL experience (schema design/modeling); familiarity with vector DBs.
-
Proven track record designing and shipping cloud-native systems on AWS (e.g., S3, Lambda, ECS/EKS, SQS/SNS, RDS/DynamoDB, CloudWatch, IAM).
-
Significant experience building/operating crawlers/parsers and robust ETL/ELT pipelines.
-
Hands-on experience with CI/CD and containerization (GitHub Actions/Jenkins, Docker, Kubernetes).
-
Strong engineering craft: architecture reviews, coding standards, testing strategy, performance tuning, maintainable design.
-
Strong DevOps/SRE capability on AWS: can own production ops, set up observability/alerts, handle incidents, and drive reliability improvements.
-
Excellent communication: clear design docs, strong stakeholder communication, actionable feedback.
Preferred / Good to Have (Prioritized)
-
Advanced Cloud Ops: cost optimization, capacity planning, security hardening, performance tuning at scale.
-
Data/Streaming: Airflow, Spark, Kafka (or equivalents).
-
Platform maturity: GitOps (ArgoCD/Flux), blue-green/canary deploys, feature flags, strong rollback discipline.
-
Stable power and backup arrangeSecurity depth: threat modeling, WAF, audit logging, secrets rotation, compliance-minded engineering. ments.
-
Multi-cloud exposure: GCP/Azure familiarity.
-
Frontend/JS exposure (nice-to-have only).
-
Hiring/interviewing, onboarding, and talent development experience.
What Success Looks Like:
-
Consistent delivery of well-designed, reliable systems with clear documentation and measurable reliability.
-
Teams that ship high-quality code under your guidance, with junior engineers growing through active mentorship.
-
Thoughtful technical decisions that balance delivery speed, cost, security, and long-term maintainability.
Work‑from‑Home Requirements:
-
High‑speed internet for calls and collaboration.
-
A capable, reliable computer (modern CPU, 16GB+ RAM).
-
Headphones with clear audio quality.
-
Stable power and backup arrangements.
Forage AI is an equal opportunity employer. We value curiosity, craftsmanship, and collaboration.
Apply Now
