Marcio Kugler Rodrigues

Hey there, I write about technology in general. These are summaries i write during my own learning. Hope you enjoy!

Read this first

Semantic Search and Vector Databases

astro.png

Semantic Search

Semantic search is a powerful technique to improve the user experience and the quality of search results by understanding the meaning and intent behind queries. It relies on vector representations of data, which can be stored and queried using vector databases. Unlike traditional keyword-based search engines that focus on finding documents containing specific words, phrases, or sequences, semantic search aims to comprehend the underlying meaning behind those words and their connections. As a result, this type of search engine delivers more targeted, intuitive, and intelligent outcomes.

While still relatively young compared to conventional keyword-based search engines, semantic search has shown great potential across diverse sectors including healthcare, education, research, and business analytics. Its capacity to derive insights from unstructured data makes it...

Continue reading →


Understanding LLMs in Troubleshooting application issues

DALL·E 2023-12-28 14.21.06 - An image depicting a cloud application error scenario with a system administrator using OpenAI's ChatGPT for troubleshooting. Include a computer scree.png

LLMs are AI models trained on vast amounts of text data. They excel in understanding, generating, and manipulating human language.
LLMs are powerful tools for natural language processing (NLP) tasks, such as text generation, summarization, translation, and more.

How LLMs Aid in Root Cause Analysis

Cloud incidents are unplanned interruptions or degradations of cloud services that can affect customers and service providers.

In the context of monitoring applications, they can be used to:

  • Analyze Logs and Error Messages: LLMs can read and interpret logs and error messages, understanding the context and nuances in the text.

  • Pattern Recognition: They can identify patterns in data that might indicate the root cause of an issue, especially in cases where the pattern is subtle or complex.

  • Suggest Solutions: Based on their training, LLMs can suggest potential solutions or steps for...

Continue reading →


How Hierarchical Navigable Small Worlds Enhance Large Language Models

img1.png

Blending Hierarchical Navigable Small Worlds with AI: The Future of Customized Language Models

https://github.com/marciokugler/llms-demo-chat

Today, we delve into the intersection of Hierarchical Navigable Small Worlds (HNSWs) and large language models (LLMs). Let’s explore how vector databases create these intricate worlds, providing custom-tailored AI experiences.

The integration of HNSWs and LLMs represents a significant leap in AI customization. Creating domain-specific ‘small worlds’ allows AI to offer more precise and relevant assistance across various sectors.
LLMs often struggle with capturing the nuances and contexts of specific domains, such as medicine, law, or finance. This is because LLMs are trained on massive and diverse corpora of text, which may not reflect the specialized vocabulary, syntax, and knowledge of a particular domain. Moreover, LLMs may not be able to...

Continue reading →


The Rise of Local LLMs: A New Era in AI

DALL·E 2023-12-28 14.24.12 - A conceptual image illustrating the rise of local Large Language Models (LLMs) in the era of AI. The image should depict a diverse array of people fro.png

The world of Artificial Intelligence is witnessing a pivotal shift with the emergence of local Large Language Models (LLMs). Amidst this revolution stands OpenLlama, a beacon of innovation and adaptability.

Why You Should Try Local LLMs and OpenLLaMA
Large language models (LLMs) are powerful tools for natural language processing (NLP) tasks, such as text generation, summarization, translation, and more. However, most of the popular LLMs are hosted on cloud platforms and require an internet connection, an API key, and sometimes a subscription fee to access. This can pose some limitations and challenges for users who want to use LLMs for their own projects, especially if they have sensitive or proprietary data, need more customization, or want to avoid security risks.

Why Go Local with LLMs?
The charm of local LLMs like OpenLlama lies in their customization. They offer enhanced...

Continue reading →