Building a tractography model involves complex, multi-step processes and requires continuous decision-making under uncertainty at various stages. As a PhD student, my focus is on developing multi-task, self-interpretable transformers to build a probabilistic tractography model. I aim to train this model for various tasks, including denoising, segmentation, diffusion reconstruction, and fiber tracking. Existing dMRI datasets will be used to train the model and our agent will be able to process multi-modal data.