HMFoDG Implementation - Analytical Curiosity for RAG Auditing.
In the Hierarchical Metric Flow on Data Graphs (HMFoDG) implementation, an interesting analytical feature emerged. It enables auditing of RAG systems (and embeddings or any vectorized data - biotech, medical, finance, physics, etc.) by tracing the selected associations in a deterministic way (without heuristics). This means deterministically tracking what the transformer actually used during the reinforcement process that caused one token to lie close to another. These are very concrete references (e.g., author, specific tokens from the text that in sufficient quantity allow source identification). Read more…