It's a good job I wasn't being interviewed for this job, as I have not one iota of a smidge of a clue what PEFT and LORA are. And I have no idea what varieties of prompting technique there are.

PEFT is more niche as it's a specific library (https://github.com/huggingface/peft) that creates LoRAs, but for a machine learning engineer working with LLM models outside of just prompting an API, it's within scope to know why/how a LoRA should be used.