Using a Dockerized PI with Ollama to code Laravel project running in a Docker container. PI is a minimal harness, but it has no guardrails, so it can alter your system with the same rights as the user running it. So it can install packages. Dockerized PI image The Dockerfile: Create the image with: Not […]
Download a file from HugginfFace: This means: If you want to run this model with more context, you have to set the KV cache to a smaller size: This way it still runs on a Macbook Pro M1 with 32GB of RAM. Note that if you later want to run the same model, just use […]
Introduction Docling is a powerful document parsing, conversion, and chunking solution that supports OCR, layout analysis, and table extraction. While the docling-serve Docker image provides a convenient REST API, it does not automatically download required models on first use—unlike the standalone version. This article explains how to preload models into a custom Docker image to […]
There are different tokenizers for different LLM models. For example OpenAI uses tiktoken, while Mistral uses sentencepiece (or you can use AutoTokenizer from the transformers package). When use tokenizers: Tokenizer for Mistral and OpenAI See the difference between them. Use it with Docling when chunking
To base64 encode a file: To decode it:
What we want to achieve: These are the steps needed to accomplish this. Symlink to codebase Each hostname should have be a symlink to the original codebase. For example our codebase is in /var/www/codebase and if we have a new hostname we should create a symlink to this codebase, for example a symlink /var/www/host1 pointing […]
There is some information about using different colors for the AdminLTE dashboard, but this is either too old (still uses Grunt and LESS files) or there's not enough information for someone who is not experienced in running the NPM scripts. So below are the steps to build the AdminLTE CSS with custom colors for the […]
WordPress and Laravel are popular frameworks that are good at what they are designed for. WordPress excels in managing content with revisions, taxonomies and a pretty good UI. Laravel is good in managing structured data with its eloquent models, routing and securing access to routes. Sometimes a project requires both the management of a lot […]
I saw this error when I was compiling a Titanium app. After some time I figured out this was happening after I added a second module to my project made in Kotlin (and not in Java). Apparently Kotlin adds this file to the build using the name of the directory. Because Titanium modules always have […]