What an AI Developer Actually Does, From One Who Ships Them
An AI developer builds software where a model does part of the work: reading documents, answering customers, scoring leads, drafting text or deciding the next step in a process. The model is usually the smallest part of the job. Most of the work is the code around it: getting clean data in, calling tools and APIs safely, checking the output, handling failure, and keeping the cost and the behaviour stable once real users arrive.
I am an AI developer, and most of what I do on a given day would not look like AI to someone watching over my shoulder. It looks like API integration, database design, retry logic and reading logs. That is not a complaint. It is the most useful thing to understand about the role before you hire one, become one, or try to rank for the term.
What is an AI developer?
An AI developer is a software developer who builds applications on top of AI models, rather than training those models from scratch. IBM describes artificial intelligence as technology that lets computers simulate learning, comprehension, problem solving and decision making. The AI developer is the person who takes that capability, usually through a large language model, and turns it into something a business can actually rely on.
In practice the job sits in three layers:
- The model layer. Choosing a model, writing the prompts, defining the tools it can call, and deciding what context it sees. This is the part people picture.
- The system layer. The application, the database, the queue, the integrations with a CRM or an ERP, the authentication and the permissions. This is most of the hours.
- The operations layer. Logging, evaluation, cost tracking, alerting, and the plan for when the model says something wrong to a customer. This is what separates a demo from a system.
Someone who only works the first layer is a prompt writer. Someone who only works the second is a regular software developer. An AI developer owns all three.
AI developer vs AI engineer vs ML engineer
The titles overlap and job boards use them interchangeably, but there is a useful distinction.
| AI developer | AI engineer | ML engineer | |
|---|---|---|---|
| Main output | Applications and automations that use models | AI platforms, pipelines and infrastructure | Trained and tuned models |
| Works with models by | Calling them through APIs and tools | Serving, scaling and monitoring them | Training and evaluating them |
| Typical stack | TypeScript or Python, LLM APIs, n8n, Postgres, a web framework | Cloud, containers, vector stores, LLMOps tooling | PyTorch, data pipelines, GPUs, experiment tracking |
| Closest to | The business process | The platform | The data science |
IBM frames AI engineering as the discipline of designing and running AI systems at scale, and machine learning as the field of systems that learn from data. An AI developer borrows from both, but the job is closer to the business process than either. If a company asks for "an AI developer", they usually mean someone who can take a messy workflow and make a model do part of it reliably.
What an AI developer actually builds
From my own work over the last four years, across more than thirty businesses, the builds fall into a handful of shapes:
- Document and data extraction. Invoices, contracts, solicitations, intake forms. The model reads, a schema validates, and a human sees only what fails validation.
- Agents that take actions. A model that can search, call an API, update a record and decide the next step. IBM's overview of AI agents is a fair primer. I wrote up what an AI agent developer builds and where agents break separately.
- Retrieval over private knowledge. Answering questions from a company's own documents using retrieval-augmented generation, so the model cites the policy instead of inventing one.
- Voice and chat agents. Inbound and outbound calls and chats with escalation to a human. There is a detailed example in the healthcare voice agent piece.
- AI inside a product. Features in a SaaS app that write, score, classify or recommend. BidStrike, one of my own products, scores government solicitations from 0 to 100 and drafts compliant proposals. How an AI application gets built walks through that kind of work step by step.
The skills that matter in production
Course syllabuses for AI developers lean heavily on model theory. The skills that decide whether a build survives its first month are more ordinary.
1. Software engineering first
Version control, tests, typed code, clean data models, deployment. A model wrapped in bad software is still bad software. Every AI system I maintain is mostly TypeScript, Python, SQL and configuration.
2. Integration and API work
The model is only useful once it can read from and write to the systems a business already runs. OAuth, pagination, rate limits and webhooks are where the real time goes. I covered why in custom API integration is 20 percent connection and 80 percent everything after.
3. Prompt and tool design
Prompt engineering matters, but tool design matters more. Giving the model three narrow, well-described tools beats one broad tool every time. Anthropic's guide to building effective agents makes the same argument: start with the simplest pattern that works, and add autonomy only when it earns its place.
4. Evaluation
You cannot improve what you do not measure. A good AI developer keeps a set of real inputs with known good outputs and runs every prompt or model change against it before shipping. Without that, every "improvement" is a guess.
5. Risk and failure handling
Models produce hallucinations, get prompt-injected and occasionally return nothing at all. The OWASP Top 10 for LLM applications and NIST's AI Risk Management Framework are the two references I point clients to. The practical version: validate every output against a schema, never let the model hold a credential, and log every tool call.
6. Cost awareness
Token spend scales with usage, not with the contract. An AI developer should be able to tell you the cost per run before launch and show it on a dashboard after.
A day of AI development, honestly
A representative day on a live build looks like this. Morning: a client's CRM sync is failing because a field was renamed in HubSpot, so the extraction step is writing to nothing. Fix the mapping, replay the failed runs. Midday: the evaluation set shows a new model version is better at summaries but worse at following the output schema, so the swap waits. Afternoon: build a new tool for the agent so it can check a calendar before offering a slot, with a hard limit on how far ahead it can book. Evening: review the cost dashboard and cut a prompt that had grown to four thousand tokens of instructions nobody needed.
Maybe an hour of that touched the model directly. That ratio is normal, and it is the clearest sign that you are talking to someone who has run AI in production rather than in a notebook.
How to tell a strong AI developer from a weak one
- They ask about your data and your systems before they ask about models.
- They can show something running in production, not only a demo video.
- They talk about failure modes unprompted: what happens when the model is wrong, slow or down.
- They have opinions about when not to use AI at all. A rules engine or a plain SQL query is often the right answer.
- Their code is readable and you will own it at the end.
If you are on the hiring side of that list, I wrote a longer checklist in hire an AI developer: what to check before you sign.
Who I am, and why this is on my site
I am Ammar Imtiaz, an independent AI developer. I build AI automation, AI agents, CRM integrations and the web applications that tie them together. Six systems I built are running in production right now, and two are products of my own with the code public on GitHub. Everything in this article comes from that work, not from a course outline.
Frequently asked questions
What does an AI developer do?
An AI developer builds applications and automations where an AI model does part of the work, such as reading documents, answering customers or deciding the next step in a process. Most of the job is the software around the model: integrations, data handling, validation, logging, evaluation and cost control, so the system behaves reliably once real users arrive.
Is an AI developer the same as an AI engineer?
Not quite. An AI developer mostly builds applications that call models through APIs and tools, and works close to the business process. An AI engineer usually builds and runs the platforms and pipelines that serve models at scale. The titles overlap heavily, and many job listings use them interchangeably.
What skills does an AI developer need?
Solid software engineering comes first: version control, typed code, databases and deployment. On top of that, API integration, prompt and tool design, evaluation against real test cases, failure handling for hallucinations and prompt injection, and an eye on token cost. Model theory helps, but production builds rarely fail on theory.
Do AI developers need to train their own models?
Rarely. Most business AI development uses hosted models such as Claude, GPT or Gemini through their APIs, adding retrieval over private data or light fine-tuning where it is justified. Training a model from scratch is machine learning engineering work and is only worth it for narrow, high-volume problems with lots of labelled data.
How do I know if I need an AI developer or a regular developer?
If a step in your process needs judgement on unstructured input, such as reading an email, a contract or a call transcript, an AI developer is the right hire. If every step can be written as a clear rule, a regular developer or a workflow tool will be cheaper and more predictable.
Want this built rather than explained?
I build these systems for a living: CRM architecture, API integration and AI automation that runs without a person babysitting it. Six are in production right now, and two are products of my own with the code public. If you have a process that is breaking, book a call and bring it. Twenty minutes, no pitch.