forked from letta-ai/letta-evals
-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathdefault_judge_rubric.txt
More file actions
104 lines (60 loc) · 4.77 KB
/
Copy pathdefault_judge_rubric.txt
File metadata and controls
104 lines (60 loc) · 4.77 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
Evaluate the agent's response based on the following criteria:
1. **Correctness (0.6 weight)**: Does the response contain accurate information from the webpage? Check if the answer matches what was requested in the input.
2. **Format (0.2 weight)**: Is the response formatted correctly? The input often requests answers in a specific format (e.g., in brackets like {Answer}).
3. **Completeness (0.2 weight)**: Does the response fully address the question without unnecessary information?
Scoring Guidelines:
- 1.0: Perfect response - correct, properly formatted, and complete
- 0.75-0.99: Good response - minor formatting or completeness issues
- 0.5-0.74: Adequate response - correct information but format/completeness problems
- 0.25-0.49: Poor response - partially correct or missing key information
- 0.0-0.24: Failed response - incorrect or no relevant information
Below is the content of the webpage that the agent fetched in order to answer the question. Please review this content to grade correctness:
```
Title: webpage1
URL Source: https://www.york.ac.uk/teaching/cws/wws/webpage1.html
Markdown Content:
STARTING . . .
--------------
There are lots of ways to create web pages using already coded programmes. These lessons will teach you how to use the underlying HyperText Markup Language - HTML.
HTML isn't computer code, but is a language that uses US English to enable texts (words, images, sounds) to be inserted and formatting such as colo(u)r and centre/ering to be written in. The process is fairly simple; the main difficulties often lie in small mistakes - if you slip up while word processing your reader may pick up your typos, but the page will still be legible. However, if your HTML is inaccurate the page may not appear - writing web pages is, at the least, very good practice for proof reading!
Learning HTML will enable you to:
* create your own simple pages
* read and appreciate pages created by others
* develop an understanding of the creative and literary implications of web-texts
* have the confidence to branch out into more complex web design
A HTML web page is made up of tags. Tags are placed in brackets like this **< tag >**. A tag tells the browser how to display information. Most tags need to be opened < tag > and closed < /tag >.
To make a simple web page you need to know only four tags:
* < HTML > tells the browser your page is written in HTML format
* < HEAD > this is a kind of preface of vital information that doesn't appear on the screen.
* < TITLE >Write the title of the web page here - this is the information that viewers see on the upper bar of their screen. (I've given this page the title 'webpage1').
* < BODY >This is where you put the content of your page, the words and pictures that people read on the screen.
All these tags need to be closed.
#### EXERCISE
Write a simple web page.
Copy out exactly the HTML below, using a WP program such as Notepad.
Information in _italics_ indicates where you can insert your own text, other information is HTML and needs to be exact. However, make sure there are no spaces between the tag brackets and the text inside.
(Find Notepad by going to the START menu\ PROGRAMS\ ACCESSORIES\ NOTEPAD).
< HTML >
< HEAD >
< TITLE >_title of page_< /TITLE >
< /HEAD >
< BODY>
_write what you like here: 'my first web page', or a piece about what you are reading, or a few thoughts on the course, or copy out a few words from a book or cornflake packet. Just type in your words using no extras such as bold, or italics, as these have special HTML tags, although you may use upper and lower case letters and single spaces._
< /BODY >
< /HTML >
Save the file as 'first.html' (ie. call the file anything at all) It's useful if you start a folder - just as you would for word-processing - and call it something like WEBPAGES, and put your first.html file in the folder.
NOW - open your browser.
On Netscape the process is:
Top menu; FILE\ OPEN PAGE\ CHOOSE FILE
Click on your WEBPAGES folder\ FIRST file
Click 'open' and your page should appear.
On Internet Explorer:
Top menu; FILE\ OPEN\ BROWSE
Click on your WEBPAGES folder\ FIRST file
Click 'open' and your page should appear.
If the page doesn't open, go back over your notepad typing and make sure that all the HTML tags are correct. Check there are no spaces between tags and internal text; check that all tags are closed; check that you haven't written < HTLM > or < BDDY >. Your page will work eventually.
Make another page. Call it somethingdifferent.html and place it in the same WEBPAGES folder as detailed above.
start formatting in [lesson two](https://www.york.ac.uk/teaching/cws/wws/webpage2.html)
[back to wws index](https://www.york.ac.uk/teaching/cws/wws/col3.html)
```
Use the submit_grade tool to submit your evaluation with a score between 0.0 and 1.0.