I Built an AI Clone of Myself — Here's What Happened

Tech Projects Gary Yong January 28, 2025 7 min read
Building an AI Clone

What started as a weekend coding project to add some personality to my portfolio has turned into one of the most educational AI experiments I've ever conducted. "Ask Gary" was supposed to be a simple chatbot that could answer basic questions about my background. Six months and 2,000+ conversations later, it's taught me more about human-AI interaction than any industry report ever could.

Here's the story of building an AI version of myself, the technical decisions that shaped it, and the fascinating insights from watching people interact with my digital twin.

The Original Brief (To Myself)

The concept was straightforward: create an AI assistant that could handle the basic questions I get asked repeatedly—my background, experience, project details, and availability. Think of it as an interactive FAQ that could engage in natural conversation.

My requirements were simple:

  • Conversational: More engaging than static text
  • Accurate: Only provide information I'd actually share
  • Progressive: Get smarter over time based on interactions
  • Authentic: Sound like me, not a generic chatbot

Little did I know that last requirement would be the most challenging and interesting part of the entire project.

Technical Architecture: Keeping It Simple (But Scalable)

Technical Architecture

The Core Stack

I built Ask Gary using a surprisingly minimal tech stack:

  • Frontend: Vanilla JavaScript with a custom widget
  • Backend: Node.js with Express
  • AI Engine: OpenAI's GPT-4 with custom prompts
  • Memory: Session-based conversation history
  • Hosting: AWS EC2 with PM2 for process management

The beauty of this setup is its simplicity. No complex vector databases, no fine-tuned models, no microservices architecture. Just clean, maintainable code that does exactly what it needs to do.

The Personality Challenge

The hardest part wasn't the technical implementation—it was teaching an AI to sound like me. How do you distill your communication style, humor, and personality quirks into prompt engineering?

I started by analyzing my own writing patterns. I read through hundreds of my emails, Slack messages, and LinkedIn posts, looking for consistent patterns:

  • I tend to use specific examples rather than generic statements
  • I'm direct but friendly, professional but not stiff
  • I often use analogies to explain technical concepts
  • I ask clarifying questions rather than making assumptions

These insights became the foundation of Ask Gary's system prompt, which I refined over dozens of iterations based on how natural the conversations felt.

Progressive Engagement: The Secret Sauce

Here's where Ask Gary gets interesting. Instead of treating every interaction as isolated, it builds context over the course of a conversation. The system tracks:

  • What information the user has already received
  • The level of technical detail they seem comfortable with
  • Whether they're asking personal, professional, or technical questions
  • How engaged they are (based on follow-up questions)

This allows Ask Gary to provide increasingly personalized responses. If someone asks about my AI experience and then follows up with technical questions, the system recognizes they want deeper detail. If they ask personal questions, it shifts to a more casual tone.

What People Actually Ask (And What Surprised Me)

Conversation Patterns

After thousands of conversations, I've learned that people interact with AI differently than I expected. Here are the most fascinating patterns:

The "Testing" Phase

Almost everyone starts by testing the AI's knowledge boundaries. Common first questions:

  • "What's Gary's favorite color?" (Answer: I don't have one, but I like colors that work well in data visualizations)
  • "Where did Gary go to school?" (McMaster University)
  • "What's Gary's biggest weakness?" (I over-engineer solutions sometimes)

People want to understand what the AI knows and how accurately it represents me before asking more meaningful questions.

The Career Coaching Conversations

This was completely unexpected. About 30% of conversations turn into career advice discussions. People ask:

  • "How do I break into consulting?"
  • "Should I specialize in AI or stay generalist?"
  • "What's the best way to transition from X to Y?"

Ask Gary has become an impromptu career counselor, drawing on my experiences to provide personalized advice. These are often the longest, most engaged conversations.

The Technical Deep Dives

Engineers love to get technical. They ask about architecture decisions, trade-offs in AI implementations, and specific methodologies. These conversations often last 20+ messages as people probe deeper into technical details.

What's interesting is how the AI adapts its explanations based on the user's background. When someone asks about machine learning model selection, Ask Gary gauges their expertise level and adjusts accordingly.

The Uncanny Valley of Conversation

One unexpected challenge has been managing user expectations about what Ask Gary can and cannot do. Some people forget they're talking to an AI and ask questions that require real-time information or personal opinions I haven't programmed in.

The solution was to make the AI's limitations transparent and even leverage them as conversation starters. When Ask Gary doesn't know something, it says so honestly and suggests how the user could get the real answer (often by contacting me directly).

"I don't have access to Gary's calendar, but I can tell you he's usually most responsive to LinkedIn messages for scheduling discussions about AI consulting projects."

Unexpected Business Impact

Business Impact

What started as a portfolio piece has turned into a legitimate business tool. Ask Gary has:

  • Qualified leads: Many conversations end with "How do I hire Gary for a project?"
  • Built relationships: People feel like they know me before we ever speak
  • Saved time: I no longer answer the same basic questions repeatedly
  • Provided insights: I understand what people want to know about my work

Three client relationships started with Ask Gary conversations. People appreciated the ability to learn about my approach and experience before committing to a sales call.

Lessons Learned (And What I'd Do Differently)

Version 2.0 Wishlist

If I were rebuilding Ask Gary today, I'd add:

  • Voice interface: Many people want to talk rather than type
  • Better memory: Remember users across sessions
  • Visual responses: Show relevant work samples or diagrams
  • Scheduling integration: Direct booking for consultations

The Human Touch Still Matters

As sophisticated as Ask Gary has become, the most meaningful conversations still happen when people connect with me directly. The AI is excellent at providing information and initial engagement, but it can't replace human connection for complex discussions.

Ask Gary works best as a bridge—introducing people to my work and approach, then seamlessly transitioning to human interaction when appropriate.

The Psychology of Talking to Yourself

Here's something I didn't anticipate: interacting with an AI version of myself has been surprisingly reflective. Reading conversations helps me understand how others perceive my communication style and what aspects of my work resonate most with people.

It's also shown me patterns in my own thinking that I wasn't aware of. Ask Gary consistently structures responses in ways that mirror how I approach complex problems—breaking them down, providing context, offering practical next steps. Seeing this pattern externalized has made me more intentional about how I communicate.

What's Next for Ask Gary

The experiment continues. I'm exploring ways to make Ask Gary even more useful while maintaining the authentic, personal feel that makes it engaging. The goal isn't to replace human interaction but to enhance it—providing better context for meaningful conversations.

If you haven't tried Ask Gary yet, I encourage you to give it a conversation. Ask it anything you're curious about regarding AI, consulting, or career transitions. You might be surprised by how natural it feels to talk to an AI version of someone you've never met.

And if you're building your own AI assistant, remember that the technology is just the beginning. The real challenge—and the real opportunity—is in capturing the human nuances that make conversations genuinely helpful and engaging.