I think it will become more apparent over time. But consider that the practice of software engineering is a stochastic process. Give 10 different engineers the same goal, and you’ll get 10 different solutions.
If a SW dev applicant gives a 20-file generated output for a 20-line assessment problem and can’t explain single lines of “their” code, either what they should be doing or why “they” had written it, it’s gonna be a no from me, dawg. A standard problem might have different solutions, but fixing the issue of the day to the satisfaction of a rabidly vocal customer base might have one at most, and it will change multiple times on a whim.
So the LLM might have helped them cheat their way to an MSc, but there’s no cheating your way through real life.
I think it will become more apparent over time. But consider that the practice of software engineering is a stochastic process. Give 10 different engineers the same goal, and you’ll get 10 different solutions.
At that rate me walking to the store is stochastic because a grand piano could fall on my head. We have to draw the line at some logical point.
If a SW dev applicant gives a 20-file generated output for a 20-line assessment problem and can’t explain single lines of “their” code, either what they should be doing or why “they” had written it, it’s gonna be a no from me, dawg. A standard problem might have different solutions, but fixing the issue of the day to the satisfaction of a rabidly vocal customer base might have one at most, and it will change multiple times on a whim.
So the LLM might have helped them cheat their way to an MSc, but there’s no cheating your way through real life.