-
Coding Intelligence for Beginners Group Lab
Join us online to ask questions, get advice, and follow the discussion about getting started with coding intelligence. Conducted in English.
Chapters
- 0:00:00 - Introduction
- 0:05:31 - Where is the best place to learn all the commands like /plan and more?
- 0:06:27 - As developers adopt agent-first workflows, what unique advantages does Xcode's built-in Coding Intelligence provide over external AI agents, and how does Apple see the future of AI and Xcode?
- 0:10:31 - Does the Xcode 27 UI indicate the amount of agentic resources being consumed while carrying out a request?
- 0:12:08 - If the Xcode AI agent needs to read or search implementations from other projects, can we add additional working directories to its context for cross-project references?
- 0:15:33 - Coding Intelligence builds features but doesn't explain them. Please add an optional "explain what I just did and why" summary after each task — we want to learn, not just ship.
- 0:21:17 - What are some common mistakes the coding assistant makes that beginners would find hard to catch on their own?
- 0:24:49 - No undo button: Xcode Coding Intelligence needs an "Undo Agent Changes" button when the agent edits many files — git is the only rollback and beginners don't know it.
- 0:29:03 - I have years of iOS experience but little with AI coding assistants. How would Apple recommend using Xcode's Coding Intelligence to build the AI-assisted skills industry now expects?
- 0:34:07 - What are the key differences between Agent mode and Chat mode? Connecting Xcode to a local LLM in chat mode gives very different results than the Coding Intelligence demo.
- 0:38:15 - If I use a local model with Xcode instead of a cloud model, what do I miss — just slower or less accurate answers, or whole agentic features?
- 0:40:36 - Can I connect Coding Intelligence to a local LLM (e.g. hosted with mlx_lm.server) in Agent mode rather than Chat mode, so it can handle work in Xcode without pointing file by file?
- 0:41:20 - What can you tell me about the privacy of my app's code when accessed through a third-party LLM via Xcode? Can the LLM train on my codebase, or store data?
- 0:43:37 - What's the best way to work with AI in Xcode while offline (e.g. commuting) and without a top-spec Mac with 128 GB of RAM?
- 0:46:10 - I've been using Claude Code in the terminal for a while and barely need Xcode anymore. What am I missing?
- 0:49:16 - Is it possible to use local AI models for Coding Intelligence with Xcode 27, and how do you balance speed, accuracy, and privacy?
- 0:52:25 - For privacy reasons I don't want to give access to Anthropic, OpenAI, or Google. Is there a path to use Foundation Models as the agent for Xcode Coding Intelligence?
- 0:53:15 - Is there a beginner's guide or overview document (rather than hands-on tutorials) that gives a general map of this topic?
Resources
-
Search this video…
-
-
- 0:00:00 - Introduction
Xcode engineers introduce themselves and frame a beginner-oriented session on Coding Intelligence in Xcode 27 — the agentic coding experience, chat versus agent modes, connecting cloud and local models, the Agent Client Protocol (ACP), permissions and privacy, and how to learn agent-driven workflows.
- 0:05:31 - Where is the best place to learn all the commands like /plan and more?
Type "/" in the agent to see the commands the agent reports it supports plus any skills Xcode has loaded. You can also just ask the agent — it's aware of nearly every command and what each does. Experiment with both and try commands to discover the workflows Xcode and the agent provide.
- 0:06:27 - As developers adopt agent-first workflows, what unique advantages does Xcode's built-in Coding Intelligence provide over external AI agents, and how does Apple see the future of AI and Xcode?
The panel doesn't discuss future plans, but pointed to Xcode's advantages today: a carefully designed tool set and curated knowledge about Apple platforms and APIs given to the agent, combined with a native UI purpose-built for coding rather than a general-purpose terminal agent.
- 0:10:31 - Does the Xcode 27 UI indicate the amount of agentic resources being consumed while carrying out a request?
Xcode's UI doesn't directly surface how much agentic resource a request is consuming — instead, ask the agent, since your provider exposes a slash command for it. There are usually two separate numbers: how full the coordinating agent's primary context window is, and how much you've spent or used so far; it's easy to confuse the two. If you'd like this surfaced in the UI, file a feedback request.
- 0:12:08 - If the Xcode AI agent needs to read or search implementations from other projects, can we add additional working directories to its context for cross-project references?
This is governed by Xcode's agent security modes. By default the agent uses permission prompting — it can reach what it needs but not roam freely. You can adjust the permissions and working directories the agent is allowed to access, so you can grant access to another local project when cross-project references are needed.
- 0:15:33 - Coding Intelligence builds features but doesn't explain them. Please add an optional "explain what I just did and why" summary after each task — we want to learn, not just ship.
You can already get this by asking the agent — request an explanation in whatever form you like (a Markdown file, an HTML report, or "help me understand why you did this"). You can also configure recurring behavior via an AGENTS.md in your project so the agent explains its work by default, turning each session into a learning opportunity.
- 0:21:17 - What are some common mistakes the coding assistant makes that beginners would find hard to catch on their own?
Agents commit whole classes of bugs, like humans. The subtlest is not sharing your unstated assumptions — you may get something different from what you meant, or an unmaintainable version of what you asked for. They can also miss context. Review the output critically rather than assuming working code is correct code.
- 0:24:49 - No undo button: Xcode Coding Intelligence needs an "Undo Agent Changes" button when the agent edits many files — git is the only rollback and beginners don't know it.
Two paths already exist. You can tell the agent "this doesn't work, go back to the previous state" and it rolls back using its full context. Xcode also tracks state across each agent turn when your project has an initialized git repository, so you can open that history and revert to a prior turn.
- 0:29:03 - I have years of iOS experience but little with AI coding assistants. How would Apple recommend using Xcode's Coding Intelligence to build the AI-assisted skills industry now expects?
Start small and fold it into work you're already doing — small changes or minor bug fixes you'd rather not spend time on — so you can review the results closely and build intuition. You don't need a massive project to begin; incremental, everyday use is the fastest way to develop the skills.
- 0:34:07 - What are the key differences between Agent mode and Chat mode? Connecting Xcode to a local LLM in chat mode gives very different results than the Coding Intelligence demo.
The difference is capability. Chat mode gives the model only a small, fixed tool set — on the order of 10 to 15 things it can do to your codebase — whereas agent mode (surfaced at the top of the UI) gives it command-line tools plus nearly 60 tools inside Xcode, along with the agent wrapper that manages context and can spawn sub-agents. That's why a local model in chat mode behaves very differently from the Coding Intelligence demos, and why the recommendation is to move from chat to agents.
- 0:38:15 - If I use a local model with Xcode instead of a cloud model, what do I miss — just slower or less accurate answers, or whole agentic features?
Separate the agent from the model it talks to — you can mix and match. Xcode has supported local models (on your machine or a local server) from the start. Using a local model in chat mode gives you the chat experience; local models are getting very capable, and to get full agentic behavior you connect them through the agent path rather than plain chat.
- 0:40:36 - Can I connect Coding Intelligence to a local LLM (e.g. hosted with mlx_lm.server) in Agent mode rather than Chat mode, so it can handle work in Xcode without pointing file by file?
Yes — use ACP (Agent Client Protocol), which is the intended path. Many open-source tools and wrappers with local-model support (such as OpenCode) work this way, and ACP lets enterprises bring their own configuration and back-end harness into Xcode while keeping the more capable agent behavior.
- 0:41:20 - What can you tell me about the privacy of my app's code when accessed through a third-party LLM via Xcode? Can the LLM train on my codebase, or store data?
When you enable a coding agent and model from a partner, you see that provider's terms for how they use your code, and you're always in control of whether to allow them to use your code for training. You manage this in your account settings with the provider, so the data-use and training choices are explicit and yours to make.
- 0:43:37 - What's the best way to work with AI in Xcode while offline (e.g. commuting) and without a top-spec Mac with 128 GB of RAM?
MLX is the best way to run a capable model locally — you can run a larger, more interesting model with MLX than with any other technology on Apple devices, and there's a dedicated session on using it in this context. Combine that with agent guardrails to make offline, local work practical on more modest hardware.
- 0:46:10 - I've been using Claude Code in the terminal for a while and barely need Xcode anymore. What am I missing?
Everyone approaches agents differently, and that's fine. What Xcode adds is powerful platform-aware tools plus a purpose-built user experience — including support for non-linear flows — layered on top of the raw agent, rather than the linear back-and-forth of a terminal harness. The value is in that integrated, native experience.
- 0:49:16 - Is it possible to use local AI models for Coding Intelligence with Xcode 27, and how do you balance speed, accuracy, and privacy?
Yes — the "Run local agentic AI on the Mac using MLX" session is the best starting point. To balance speed, accuracy, and privacy, consider a hybrid: use a larger model for planning, then have a smaller local model carry out and track the work and its assumptions.
- 0:52:25 - For privacy reasons I don't want to give access to Anthropic, OpenAI, or Google. Is there a path to use Foundation Models as the agent for Xcode Coding Intelligence?
Yes — run local, agentic AI on the Mac with MLX rather than a third-party cloud provider. The Mac is a strong platform for this: even a single high-end Mac is capable, and an array of Mac Studios could host among the largest models, keeping everything on your own hardware.
- 0:53:15 - Is there a beginner's guide or overview document (rather than hands-on tutorials) that gives a general map of this topic?
For a conceptual roadmap rather than jump-in tutorials, the "Xcode agents" (Meet the coding agent) WWDC session is a good fit — especially for visual learners, since it includes illustrative diagrams of what the agent is actually doing, giving you the overall map to fill in with details later.