Thanks for the comment, I'm really enjoying the discussion it has sparked.

Yes, I'm just taking the top comments, along with a few child comments, in order to not exceed the context window of the model.

Regarding personalization, there's definitely lots of potential. HN can be so random though, sometimes you find things that you didn't even know you needed (intellectually). I guess as with most recommender systems, it's about a balance between exploration and exploitation. Maybe an MVP could filter for specific keywords and add those posts to the model input.