LLM's aren't retraining or fine-tuning themselves during the conversation, so they have no potential to learn. In fact as models get bigger and better, the cost of fine tuning them only goes up, so the possibility of them learning in real time only becomes less likely.

It does if you set the temperature to 0 and pass the same seed.

"Setting up a windows machine to minimum functionality would take hours and multiple CDs from multiple vendors." Thats what Norton Ghost is for.