Explore the Python packages driving OpenAI’s ChatGPT Code Interpreter. Code Interpreter & Python Packages ChatGPT’s Code Interpreter executes Python code, powered by a multitude of Python packages. Python, with its vast array of packages, facilitates a diverse range of projects. Here’s a glimpse into the possibilities: Data Analysis and Visualization: Analyze and visualize your data …
I’m excited to share a powerful method for accurately summarizing large documents that exceed the input size limit of GPT-4. I’ve designed a diagram to visually illustrate this approach, which leverages embeddings to check the semantic similarity of summarized blocks (chunks). This iterative process ensures that each block reaches a desired similarity threshold before being …
Enhancing Large Document Summarization with Embeddings and Semantic Similarity Read More »
Imagine you’re building a chatbot using OpenAI’s GPT-3.5-turbo, and you need it to extract specific information from users, asking one question at a time. Seems simple, right? But sometimes, crafting the perfect prompt to achieve this goal can be tricky. In this case study, we’ll explore how one client tackled this challenge and achieved the …
One of the most sought-after AI systems is one where you can easily query a knowledgebase via a ChatGPT-like interface. Basic Q&A with Embeddings Since you can’t fine-tune the newer, more conversational models like the ChatGPT API, embeddings are how you “train” them on your proprietary knowledge base. To create your embedding system, you must …
Q&A with ChatGPT + Embeddings – Basic & HyDE Examples Read More »
Importance of ChatML Language Roles in ChatML The system role Example ChatML The following is an example of ChatML in the JSON format: This example demonstrates the few-shot learning prompt using names in the system role: References
Building with LEGO bricks is a fun and creative activity that allows you to construct various structures by combining different-sized bricks in multiple ways. This same concept applies to the development of artificial intelligence (AI) systems; you can connect different AI models to meet specific requirements, creating an impressive AI system like constructing a LEGO …
“Pre-trained model” is the name I will use to refer to AI models made accessible by companies like OpenAI, with capabilities including text, image, and embedding generation. You can contrast these pre-trained models with custom models trained to solve a specific task using “big data.” It’s 2023, and there are still growing start-ups with billion-dollar …
Building a Competitive Advantage (Moat) for AI Start-ups Read More »
As an entrepreneur and consultant, I’ve spent years designing systems and implementing machine learning (ML) strategies using pre-trained models like those provided by OpenAI. During this time, I’ve talked to many business leaders seeking to improve their businesses with artificial intelligence (AI) and have encountered a few common misconceptions about what Large Language Models (LLMs), …
Common Misconceptions about the Capabilities of ChatGPT & Large Language Models (LLM) Read More »
Are you looking to implement AI in your product or service but need help figuring out where to start? For example, are you deciding whether to fine-tune, prompt engineer, or train a custom model? It can be overwhelming with all the options and advancements in AI technology. However, maximizing flexibility and agility must be the …
Maximize Your AI Success: Embrace Flexibility and Agility Read More »
People commonly refer to fine-tuning when attempting to address their problems with AI. In a recent conversation with an OpenAI Ambassador, I was told that they “convince 90% not to use fine-tuning to solve their problem,” confirming my hunch that fine-tuning is one of the most misunderstood tools in AI. Fine-tuning is often more complicated and less …
