Measuring What Matters: Building an Evaluation and Cost-Tracking Framework for my AI Financial Analyst

In this post, we will dive a bit into model evaluation. Building with Large Language Models (LLMs) presents two major challenges:

  1. How do you know if the output is any good?
  2. How do you prevent API costs from spiraling out of control?

Today, I tackled both of these head-on by building a robust evaluation and cost-tracking framework. It’s an (again) interesting learning journey but important step for moving from a fun prototype to a reliable tool.

Read More >>


Anatomy of an AI Financial Analyst: From Raw Filing to Interactive Dashboard

In the last post, I briefly outlined the project for an AI-powered tool to analyze SEC filings. In this blog, I’m diving deep into the architecture and core components that form the engine of this financial analyst.

We’ll dissect the journey of a single user request, from a ticker symbol entered into a form all the way to a rich, interactive dashboard filled with AI-generated insights.

Read More >>


LLM Learning Journey: Building an LLM-powered Financial Analyst with an AI Coding Partner

It’s been a while, but I’m happy to be back to blogging (helped by my AI assistants) with a new project and a new series! This is a dual experiment:

  1. Can we build an AI-powered tool to automate the analysis of complex financial documents for the purpose of learning the latest AI LLM techniques?
  2. How far can a developer push a project by truly partnering with AI coding assistants?

I’ll be sharing the journey right here.

The Problem: Information Overload in Finance

Before the project I had not much experience with financial documents especially company filings, only a basic understanding of their importance and relevance. After spending some time digging into them, I realized the challenge: You’re faced with mountains of dense, jargon-filled documents like 10-Ks and 10-Qs. Buried within these SEC filings is a goldmine of information about a company’s performance, strategy, and risks. But extracting and understanding it is a tedious, manual process and never even mention that not all SEC filings themselves are not standardized.

There are many websites have information about companies like Yahoo Finance, Google Finance, and others. But to build a platform with LLMs that can truly understand and analyze these documents, it’s essential to work directly with the raw data. This is where the SEC’s EDGAR database comes in, providing access to all public filings.

Read More >>


Inomad Diary-04-Infrastructure-02-Implementations-01-Azure Setup

🔎 Intro

This post is the beginning of the implementation phase for Inomad’s infrastructure on Azure. As the usual like other posts in Inomad series, I will just highlight the key points I’ve encountered instead of making the series an instruction of ‘How to’. This post will cover the initial steps and considerations for deploying Inomad’s infrastructure on Azure.

Read More >>


Inomad Diary-04-Infrastructure-01-Readings-Auditing Monitoring and Logging

🔍 Intro

Auditing, monitoring, and logging are critical components in the realm of cloud computing, ensuring operational integrity, security, and compliance. In this post, I will discuss the importance of auditing, monitoring, and logging in the cloud, and give it a detailed overview and study of these technologies.

Read More >>


Inomad Diary-04-Infrastructure-01-Readings-Security Compliance and Governance

🔎 Intro

In this post, I will explore the concepts of security, compliance, and governance in modern cloud infrastructure and their importance in ensuring the confidentiality, integrity, and availability of data and services. Security, compliance, and governance are critical aspects of cloud infrastructure that help organizations protect their assets, comply with regulations, and maintain operational efficiency.

Read More >>


Inomad Diary-04-Infrastructure-01-Readings-Messaging

🔎 Intro

In this post, I will explore the role of messaging systems in modern cloud infrastructure and their importance in enabling communication between distributed components, services, and applications. Messaging systems play a crucial role in building scalable, reliable, and decoupled architectures that can handle complex workflows and interactions in cloud environments.

Read More >>


Inomad Diary-04-Infrastructure-01-Readings-Development and Deployment

🔎 Intro

In this post, I will explore the role of development and deployment technologies in modern cloud infrastructure and their importance in building scalable, reliable, and efficient web applications and services. Development technologies encompass a wide range of tools, frameworks, and practices that enable developers to create, deploy, and maintain software solutions in the cloud.

Read More >>