DynaGen
This is an optimisation methodology that aims to maximise resource utilisation and inference throughput during the runtime on any PC. It first collects times consumed in every stage of LLM inference, then plans memory management and computation sequences ahead of time according to those profiling results, so that we can efficiently run the LLM according to the optimised plan.
To clarify, the design of the optimising strategies is based on assumptions that (i) the Host-to-Device (HtoD) and the Device-to-Host (DtoH) I/O’s will not block the computations and (ii) any required weights and KV cache of a GPU batch must be prefetched to GPU beforehand, which might deviate from the reality but is sufficient for obtaining a sub-optimal improvement.
Experiment Result
Web Calculator v1
Web Calculator v1 is a simple web-based calculator built upon Go and Vue3.js. It currently supports standard mode, keyboard mode, error detection, result recording and operations, 9-digit decimal operations, exponentiation operations, adaptive layout, and simple auto-correction.
Technology Stack
Screenshots
Online demo(link)
The Accommodators (Expired)
The Accommodators is an app developed using Tencent‘s self-developed Vue-like WePY framework and the lightweight UI component library Vant-Weapp launched by Youdao team. More than 98% of the workload of the app is completed by Zhenwei Tang alone. Till now, only the “achievement” feature is left incompleted. During the development of the app, I kept updating the development notes on the official website of the CTB event and this blog simultaneously to record the difficulties and pains in the process for future lessons. Since The Accommodators is my first mobile app, there’s still much room for optimization, which will be supplemented in future upgrades.
Screenshots
Building the Consensus on Human Rights (EN)
ABSTRACT: The Universal Declaration of Human Rights (hereinafter referred to as the Declaration), promulgated in the post–World War II period, was an epoch–making worldwide and historical document. Owing to the modification of the word “world”, debates and diplomacy were inevitable in the drafting of the Declaration, considering the various ideologies and historical contexts of nations. After conflicts and compromise, the Declaration was finally announced with the determination to protect the worldwide human rights from violations or neglects.
Gallery
