Q: 5
You have access to training data but no access to test dat
a. What evaluation method can you use to assess the performance of your AI model?
Options
Discussion
C . Average entropy approximation seems like it could provide some info about model uncertainty, especially if you don't have a test set. Not super confident, but I've seen folks mention it for evaluating predictions.
C or A. I thought average entropy approximation (C) can give you an idea of uncertainty, so maybe that's useful for assessing performance? Not fully sure though, cross-validation (A) is what I've always seen used most. Disagree?
Its A here. Cross-validation is made for cases like this where you only have training data, since it lets you split and reuse it to simulate unseen data. Pretty sure that's the only practical option from the list.
Probably A, since cross-validation splits your training data to mimic a test scenario. The other options don't really cover model evaluation without extra data. Could be wrong but this fits what I've seen in courses.
A , randomized controlled trial (B) looks tempting but that's not really standard for ML eval, right?
Seen similar on practice exams, A is the way to go here.
B not A. Cross-validation is the go-to when there's no test set since it uses training data splits for evaluation. Randomized controlled trial doesn't fit here. I think A's the best choice, unless someone sees another angle.
Its A, cross-validation lets you still estimate performance using only your training data if there's no test set.
A imo
Be respectful. No spam.
Question 5 of 15