bk99.de entertain the web since 1997

Blog 2021

27 posts

Projects, Linux, networks, systems, finds and internet standards from 2021.

Training CodeParrot from scratch

CodeParrot documents how a GPT-2-like code generator was built, from data collection to training. The article also shows how licence filtering and duplicates shape the data. The model was trained on publicly available Python code from GitHub.

Read the full post

Machine learning as versionable code

The article describes the shift from isolated models to collaborative, versioned artefacts. Models, data sets and applications are meant to be developed with working methods similar to those for source code. The Hub uses Git-based repositories for models and data sets.

Read the full post

A summer of joint open source work

The review brings together projects from an open mentoring programme around NLP, audio, computer vision and tools. It shows how small, clearly defined projects lead new contributors into complex ecosystems. The programme brought students together with mentors from the Hugging Face ecosystem.

Read the full post

RFC 9106: Argon2 for password hashing

RFC 9106 describes Argon2 as a memory-hard password derivation function and gives recommendations for secure parameters. Every implementation compliant with RFC 9106 must support Argon2id; Argon2d and Argon2i are optional. For password hashing, the RFC recommends an individual salt 16 bytes long.

Read the full post

Data breach at T-Mobile US: hacker exploited devastating security hole

In August 2021 John Binns claimed responsibility for the break-in at T-Mobile US, in which data of more than 50 million customers and prospects was leaked. According to the Wall Street Journal, the attacker used a publicly available scanner to find an unprotected router and penetrated the network from there. Stolen data included names, addresses, social security, driving licence and IMEI numbers.

Read the full post

Intel closes security holes in laptops, Linux drivers and more

In August 2021 Intel published updates for several holes in drivers and hardware. The most dangerous was CVE-2021-0084 in the Linux RDMA driver for the X722 and 800 series Ethernet controllers, through which attackers could gain higher privileges. Further holes affected NUC laptop kits, graphics drivers, Optane PMem and the 800 series Ethernet adapters.

Read the full post

Sentence Transformers in the Hub

Sentence Transformer models get a shared home with metadata and a directly usable loading function. This makes semantic search and similarity comparison easier to reproduce. Sentence Transformers produce fixed vectors for sentences and texts.

Read the full post

Combining models with Gradio

Gradio 2.0 makes models interactively usable with a few lines of Python and allows chained demos. This lowers the hurdle for checking model behaviour visibly with real inputs. Gradio generates web interfaces directly from Python functions.

Read the full post

Humanity’s ultimate limit of reach

KG shows how the accelerating expansion of the universe limits the cosmic space we can reach for good, however advanced our technology becomes. Physical limits remain real even when technical limits are pushed very far. Exploration that is not undertaken can become irreversible, because reachable matter disappears over time.

Read the full post

RFC 9000: QUIC: Secure transport over UDP

RFC 9000 defines QUIC with encrypted connections, multiple streams and path migration on top of UDP. Transport innovation can be rolled out over UDP without waiting for operating system kernels. Encrypted control data improves privacy and makes network diagnostics harder.

Read the full post

Transformers for long documents

The literature review classifies methods that avoid the quadratic cost of full attention. Local windows, sparsity and compressed representations trade a global view for scalability. Full self-attention grows quadratically with the sequence length.

Read the full post

Distributing RAG with Ray

The article combines retrieval-augmented generation with Ray to scale index search and generation across several processes and devices. Knowledge retrieval thus becomes an independent, distributed part of inference. RAG combines a retriever with a generative sequence model.

Read the full post

Fritzbox maker open to an update for Deutsche Glasfaser

In January 2021 AVM said it was prepared to give its new FRITZ!Box 5530 Fiber an adapted firmware for the Deutsche Glasfaser network if needed. The Broadband Forum had just certified the box for GPON, but there could be hurdles in practical use. However, a firmware update would not solve Deutsche Glasfaser’s actual problem with router freedom.

Read the full post

Router freedom through a Fritzbox firmware update

In 2021 Deutsche Glasfaser wanted to resolve the dispute over router freedom through talks with AVM and a FRITZ!Box firmware update. It installed an active, mains-powered fibre modem (ONT) at customers’ premises, although according to the law only passive network termination points are allowed. It charged 60 euros for removing it and threatened service restrictions.

Read the full post

Deutsche Glasfaser charges 60 euros for router freedom

In early 2021 Deutsche Glasfaser charged customers 60 euros if they wanted to connect their own router directly to the fibre instead of the operator’s ONT, and then refused contract changes. The online magazine Deskmodder reported on a complaint to the consumer advice centre and the Federal Network Agency. The operator understood router freedom to mean that customers may connect any devices via LAN behind its ONT.

Read the full post