Not that loose lol.

I’m thinking it’s still llama / dense decoder only transformer.