Skip to content

Commit

Permalink
Merge pull request #922 from RoboCupAtHome/remove_social_survey
Browse files Browse the repository at this point in the history
Remove social survery
  • Loading branch information
akinobu1998 authored Nov 25, 2024
2 parents f530a80 + 030db27 commit 7687339
Show file tree
Hide file tree
Showing 4 changed files with 1 addition and 41 deletions.
1 change: 1 addition & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ All notable changes to this project will be documented in this file.

## Rulebook [Current Draft]

* [#922](https://github.com/RoboCupAtHome/RuleBook/pull/922): Remove Bonus for perceived social intelligence as the survey was too hard to conduct in Robocup settings.
* [#887](https://github.com/RoboCupAtHome/RuleBook/pull/887): Remove Social Standard Platform League.
* The League does have a low number of participants.
* Former SSPL Teams can participate in the OPL and thus modify the Robot.
Expand Down
39 changes: 0 additions & 39 deletions pages/general_rules/PenaltiesBonuses.tex
Original file line number Diff line number Diff line change
Expand Up @@ -41,45 +41,6 @@ \subsection{Bonus for outstanding performance}\label{rule:outstanding_performanc
\item It is the decision of the \iaterm{Technical Committee}{TC} if (and to which degree) the bonus score is granted.
\end{enumerate}

\subsection{Bonus for perceived social intelligence}\label{rule:perceived_intelligence}
\begin{enumerate}
\item For the test \iterm{Receptionist} in \iterm{Stage~I} and, \iterm{Restaurant} in \iterm{Stage~II} tests. Teams are evaluated on the robot's perceived social intelligence
performance

\item This bonus, ranging from 0 to 50, depends on the robot's social performance which will be assessed by Referees using a specially designed scale in a survey.

\item The survey evaluates how the robot recognizes, adapts to, and predicts emotions, behaviors, and cognitions. Each component is assessed through several questions, scored on a scale from 1 to 5, where 1 represents "strongly disagree" and 5 represents "strongly agree." The questions used for evaluation include:
\begin{itemize}
\item This robot notices human presence
\item This robot enjoys meeting people
\item This robot recognizes individual people
\item This robot notices when people do things
\item This robot adapts effectively to different things people do
\item This robot anticipates people's behavior
\item This robot tries to be helpful
\item This robot is trustworthy
\item This robot cares about others
\item This robot tries to hurt people
\item This robot knows if someone is part of a social group
\item This robot thinks it is better than everyone else
\item This robot adapts its behavior based upon what people around it know
\item This robot is impolite
\item This robot is socially competent
\end{itemize}
Detailed information can be found in this \href{https://ipip.ori.org/PSIManualSeptember2018.pdf}{manual}.

\item In each evaluation, the score for every question is summed up and then normalized as follows:
\[ x' = N \cdot \frac{{x - x_{\text{min}}}}{{x_{\text{max}} - x_{\text{min}}}} \]

Here, \( N \) is the normalizing factor (50), \( x \) is the sum of scores for each question in the current evaluation, \( x_{\text{min}} \) is set to 15 (since there are 15 questions), and \( x_{\text{max}} \) is set to 75 (as the maximum score for each question is 5).

\item The final score is calculated as the average of individual evaluator scores.

\item The referee has the authority to skip the social assessment test if they believe the robot's performance is not suitable for measurement.

\item After the test is completed, the evaluators will fill out the form, and the scores will be automatically recorded in this \href{https://urjc-my.sharepoint.com/:x:/g/personal/juan_pena_urjc_es/Eb4WyP1H4-FCqeW-qVZ3mF0BRzBR1Cn-J5ltluy90fhTJQ?rtime=guRqYF483Eg}{spreadsheet}.
\end{enumerate}

% Local Variables:
% TeX-master: "../Rulebook"
% End:
1 change: 0 additions & 1 deletion scoresheets/Receptionist.tex
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@
\scoreitem[2]{100}{Offer a free seat to the new guest}
\scoreitem[2]{25}{Look at the person talking}
\scoreitem[2]{50}{Look at the person the robot is introducing the guest to}
\scoreitem{50}{Qualitative robot social performance \ifShortScoresheet{(see sec.~\ref{rule:perceived_intelligence})}}

\scoreheading{Bonus Rewards}
\scoreitem[2]{100}{Open the entrance door for a guest}
Expand Down
1 change: 0 additions & 1 deletion scoresheets/Restaurant.tex
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,6 @@

\scoreitem[2]{300}{Take an order.}
\scoreitem[2]{300}{Serve an order.}
\scoreitem{50}{Qualitative robot social performance \ifShortScoresheet{(see sec.~\ref{rule:perceived_intelligence})}}

\scoreheading{Bonus Rewards}
\scoreitem[2]{200}{Use an unattached tray to transport}
Expand Down

0 comments on commit 7687339

Please sign in to comment.