Use locally installed fonts in the LaTeX Docker container by mounting your fonts directory to /usr/local/share/fonts, e.g.
docker --volume=/usr/share/fonts:/usr/local/share/fonts pandoc/latex …
Should work with XeLaTeX and LuaLaTeX PDF engines as well as with the "typst" container.