我最近在学习 DeepLearning.AI 的 ChatGPT Prompt Engineering for Developers 课程时遇到了 GPT-3.5-turbo 响应不一致的情况。该问题围绕计算太阳能发电装置第一年运营的总成本进行。每当我重新运行 DeepLearning.AI 给出的提示消息时，模型都会响应两个解决方案，我正在寻求对差异的澄清。
提示：
f"""
Your task is to determine if the student's solution \
is correct or not.
To solve the problem do the following:
- First, work out your own solution to the problem.
- Then compare your solution to the student's solution \
and evaluate if the student's solution is correct or not.
Don't decide if the student's solution is correct until
you have done the problem yourself.
Use the following format:
Question:
```
question here
```
Student's solution:
```
student's solution here
```
Actual solution:
```
steps to work out the solution and your solution here
```
Is the student's solution the same as actual solution \
just calculated:
```
yes or no
```
Student grade:
```
correct or incorrect
```
Question:
```
I'm building a solar power installation and I need help \
working out the financials.
- Land costs $100 / square foot
- I can buy solar panels for $250 / square foot
- I negotiated a contract for maintenance that will cost \
me a flat $100k per year, and an additional $10 / square \
foot
What is the total cost for the first year of operations \
as a function of the number of square feet.
```
Student's solution:
```
Let x be the size of the installation in square feet.
Costs:
1. Land cost: 100x
2. Solar panel cost: 250x
3. Maintenance cost: 100,000 + 100x
Total cost: 100x + 250x + 100,000 + 100x = 450x + 100,000
```
Actual solution:
"""
response = get_completion(prompt)
print(response)
当我重新运行提示时，模型会响应两种不同的解决方案：
第一个解决方案：
To calculate the total cost for the first year of operations, we need to add up the costs of land, solar panels, and maintenance.
1. Land cost: $100 / square foot
The cost of land is $100 multiplied by the number of square feet.
2. Solar panel cost: $250 / square foot
The cost of solar panels is $250 multiplied by the number of square feet.
3. Maintenance cost: $100,000 + $10 / square foot
The maintenance cost is a flat fee of $100,000 per year, plus $10 multiplied by the number of square feet.
Total cost: Land cost + Solar panel cost + Maintenance cost
So the actual solution is:
Total cost = (100 * x) + (250 * x) + (100,000 + (10 * x))
Is the student's solution the same as the actual solution just calculated:
Yes
Student grade:
Correct
第二种解决方案：
To calculate the total cost for the first year of operations, we need to add up the costs of land, solar panels, and maintenance.
1. Land cost: $100 / square foot
The cost of land is $100 multiplied by the number of square feet.
2. Solar panel cost: $250 / square foot
The cost of solar panels is $250 multiplied by the number of square feet.
3. Maintenance cost: $100,000 + $10 / square foot
The maintenance cost is a flat fee of $100,000 per year, plus $10 multiplied by the number of square feet.
Total cost: Land cost + Solar panel cost + Maintenance cost
So the actual solution is:
Total cost = (100 * x) + (250 * x) + (100,000 + (10 * x))
Is the student's solution the same as the actual solution just calculated:
No
Student grade:
Incorrect
值得注意的是，课程的预期答案与第二个答案一致。然而，该模型不一致地在同意和不同意这个预期解决方案之间交替。
我正在寻求有关处理模型响应中这种可变性的见解，了解我的提示中是否存在错误，或者模型的一致性是否存在问题。
您不能期望 ChatGpt (OpenAI) 具有严格的一致性和确定性。就我而言，我多次提示它以某种格式将文本从英语翻译成塞尔维亚西里尔字母，对于相同的提示，我有时会得到我想要的东西，但有时格式会改变，有时甚至会混合西里尔字母和拉丁语表示不同的单词？！
尽管我很熟悉ChatGPT，但它不太擅长计算。