* Posts by From the North

2 publicly visible posts • joined 15 Jul 2024

Before we put half a million broadband satellites in orbit, anyone want to consider environmental effects?

From the North

Tonga finally gave SpaceX permission to run Starlink there in Jul 22, 2024.

Geosync's biggest usability issue is latency, which is inherently 240ms per round trip (generally two for a request and response).

This comment is coming to you from Alaska via Starlink, which is 10x higher bandwidth than the long copper line alternative here, while bouncing off those same inter-sat mesh links down to Seattle.

Honey, I shrunk the LLM! A beginner's guide to quantization – and testing it

From the North
Thumb Up

Several precompiled options

You don't need to compile llama.cpp, there's a nice free local LLM GUI "LM Studio". On non-Windows platforms the single file executable version "llamafile" has the inference engine and weights baked into a single executable, and you interact via a localhost browser interface (Windows users are limited to 4GB, which fits only the smallest models).