AI Prompt Developer
- Role
- AI / ML
- Experience
- Mid
- Employment
- Full-time
- Company size
- Enterprise
Open to Anywhere in South America. Set where you work from to check your eligibility.
No BS summary
AI prompt developer with 2+ years building software or AI/LLM components. Needs hands-on prompt work for real applications, Python or similar, APIs, JSON, Git, LLM fundamentals, RAG basics, and clear written English. Must work remotely from South America with daily overlap with US business hours.
Core skills
Required skills
Optional skills
Required languages
Caravel | BPM Technology Solutions
| | | | | | | | | | | | | | | | | | | | | | | | | | - | | | | | | | | | | | | | | | | | | | | | | |
AI Prompt Developer
AI Practice / Emerging Technology (TSS) · Full-time · Fully remote — South America · Reports to: AI Practice Lead
About Caravel
Caravel | BPM Technology Solutions is an award-winning NetSuite and Salesforce partner and part of BPM LLP, a Top-40 accounting and advisory firm. For 20+ years and 1,000+ implementations we've helped businesses across North America put the right technology to work — honestly, and without the usual consulting theater. We're a fully remote team with delivery centers across the US, Canada, India, and the Philippines, and we're standing up an AI practice to match.
About the role
As an AI Prompt Developer at Caravel, you'll build the production layer of our AI practice — the prompts, prompt chains, and LLM-driven components that power client solutions and the internal accelerators our consultants rely on. You'll partner with our AI Specialists to turn solution designs into reliable, evaluated, production-ready builds. This is a hands-on build role for someone who cares about getting model behavior right, not just getting it to run.
What you'll do
- Design, build, test, and iterate on prompts and prompt chains for production LLM workflows across client delivery and internal automation.
- Implement evaluation harnesses, guardrails, and regression tests so output quality is measurable and stays stable over time.
- Integrate LLM components with business systems and data — APIs, retrieval/RAG pipelines, and structured outputs.
- Partner with AI Specialists to convert solution designs into production builds, and document patterns for reuse.
- Tune for accuracy, cost, latency, and safety against real evaluation data — not vibes.
- Grow Caravel's library of reusable AI accelerators.
What you'll bring
- 2+ years building software or AI/LLM components, including hands-on experience crafting and iterating prompts for real applications.
- Working knowledge of LLM fundamentals: context windows, few-shot prompting, function/tool calling, structured outputs, and RAG basics.
- Proficiency in Python (or similar) and comfort with APIs, JSON, and version control (Git).
- A test-and-measure mindset — you evaluate output quality, you don't eyeball it.
- Clear written English and strong documentation habits.
- Ability to collaborate across time zones with an onshore/nearshore team.
Bonus points
- Experience with evaluation frameworks (e.g., promptfoo, Ragas, or custom eval harnesses).
- Familiarity with embeddings, vector databases, and retrieval pipelines.
- Exposure to ERP/CRM ecosystems (NetSuite, Salesforce) or business-process automation.
- Experience with agentic frameworks and orchestration.
Location & schedule
Full-time, fully remote within South America, with daily overlap with US business hours to collaborate with the AI Specialist team.
Why Caravel
You'll help build a brand-new AI practice inside a firm with two decades of delivery credibility — real client problems, real production systems, and a team that would rather tell you the truth than sell you a demo.
Compensation & benefits
Competitive base commensurate with experience, a fully remote setup, and the opportunity to help shape a new AI practice from the ground up.
\n
\n
$30,000 - $42,000 a year
\n
What you'll do
- Design, build, test, and iterate on prompts and prompt chains for production LLM workflows.
- Implement evaluation harnesses, guardrails, and regression tests for measurable output quality.
- Integrate LLM components with business systems and data, including APIs, RAG pipelines, and structured outputs.
- Partner with AI Specialists to convert solution designs into production builds.
- Document reusable patterns.
- Tune AI outputs for accuracy, cost, latency, and safety using evaluation data.
- Grow Caravel's library of reusable AI accelerators.
What they require
- 2+ years building software or AI/LLM components.
- Hands-on experience crafting and iterating prompts for real applications.
- Working knowledge of LLM fundamentals: context windows, few-shot prompting, function/tool calling, structured outputs, and RAG basics.
- Proficiency in Python or similar.
- Comfort with APIs, JSON, and version control.
- Test-and-measure mindset for evaluating output quality.
- Clear written English and strong documentation habits.
- Ability to collaborate across time zones with an onshore/nearshore team.
- Daily overlap with US business hours.
Benefits
- Competitive base commensurate with experience.
- Fully remote setup.
- Opportunity to help shape a new AI practice from the ground up.
BPM India Advisory Service Private Limited, formerly Burr Pilger Mayer India Private Limited, is a subsidiary of BPM LLP. Founded in 1986, BPM is one of the largest California-based accounting and consulting firms, ranking in the top 50 in the country, with 17 office locations and services for emerging and mid-cap businesses and high-net-worth individuals across multiple industries.