You might need to point to the fonts file: export FONTCONFIG_FILE='/opt/local/etc/fonts/fonts.conf' is what I do, at least when using a git compile instead of the MacPorts one.