Running Models Locally
Running small models on my own computer, with notes on environment setup, model selection, and inference practice.
THE NOTEBOOK
50 entries
50 results
Running small models on my own computer, with notes on environment setup, model selection, and inference practice.
Reading BackdoorIndicator: using out-of-distribution data to proactively detect backdoor attacks in federated learning.
Building a task-list backend with Go and Kratos: service design and development notes.
Understanding inversion of control and dependency injection, and their role in Go projects.
Learning Kratos's project structure, service definitions, and microservice development workflow.
The design and implementation of a short-link project: generation strategy, database, cache, and redirection.
Notes on the syntax of the go-zero API description language and how code is generated from it.
Practicing go-zero API, database, and microservice development through a service example.
Notes on Protocol Buffers syntax, message definitions, and usage.
A Quarto blog template centered on writing in Markdown, documenting how content is organized and published.
Learning go-zero's framework structure and service development process.
Notes on service discovery, health checks, and basic Consul usage.
A reading guide to DeepSeek V2, V3, R1, VL2, and OCR, separating architecture, training, and deployment.
An overview of the infrastructure and common components involved in developing Go services.
Rewriting Two Sum, Group Anagrams, and Longest Consecutive Sequence as standalone Go programs, and explaining the input, output, and edge cases.
Useful Windows, macOS, and Linux shortcuts and command-line reminders.
A reference for everyday Git commands, commits, branches, and remote collaboration.
Learning Go-Kit's layering approach and microservice components.
Notes on organizing services and choosing a Go microservice framework.
Notes on the approach, complexity, and Go tests for Two Sum, Group Anagrams, and Longest Consecutive Sequence, plus the effect of map ordering.
From prompts to context to tools and agents: a record of how AI interaction has changed.
Starting from the basic retrieval and generation pipeline, this article covers RAG's architecture, multimodal extensions, and the problems encountered in practice.
A guide to the basic concepts, training methods, and typical architectures of vision-language models, and how images enter a language model.
Diagnosing slow file transfers to a local server, and recording workable ways to improve them.
A small web tool that turns daily notes into a long, high-resolution image.
Combines gesture recognition with front-end visuals so the fireworks on screen follow your fingers.
Follow-along practice with the variable-length sliding window, discussing the validity condition and how to find the shortest window.
A follow-along on fixed-length sliding windows, using basic problems to understand window movement and state updates.
Set up Ruby, install Jekyll, and run a local blog on macOS.
Install Ruby and Jekyll on Windows and prepare a local blog environment.
From BM25 retrieval to document QA, recording the environment setup, dependency problems, and practical results.
A record of the deployment environment, run steps, and test results for DeepSeek-R1-32B.
Install g and switch between Go versions.
A summary of common open source licenses and their differences, and an overview of the conventions for using and releasing code.
Combining Sunshine, Moonlight, and a virtual display to build a remote desktop streaming solution.
Part 10 of my Go fundamentals notes: pointers, initialization, swapping values, and nil.
Part 11 of my Go fundamentals notes: syntax, examples, and lessons learned.
Separate packages from modules and understand go.mod, go.sum, dependency commands, GOPROXY, and replace.
Part 13 of my Go fundamentals notes: unit tests, table-driven tests, and benchmarks.
Part 9 of my Go fundamentals notes: syntax, examples, and lessons learned.
Part 8 of my Go fundamentals notes: syntax, examples, and lessons learned.
Part 7 of my Go fundamentals notes: syntax, examples, and lessons learned.
Part 6 of my Go fundamentals notes: syntax, examples, and lessons learned.
Part 5 of my Go fundamentals notes: syntax, examples, and lessons learned.
Part 4 of my Go fundamentals notes: syntax, examples, and lessons learned.
Part 3 of my Go fundamentals notes: declarations, constants, iota, and scope.
Part 2 of my Go fundamentals notes: syntax, examples, and lessons learned.
Part 1 of my Go fundamentals notes: preparing a Windows development environment.
Starting from GitHub and Jekyll, a complete record of building a personal website.
Understand machine learning through concrete examples: loss functions, gradients, and model training.
No matching notes. Try another keyword.