Like any genAI model,En la intimidad Google Gemini responses can sometimes be inaccurate, but in this case it might be because testers don't have the expertise to fact-check them.
According to TechCrunch, the firm hired to improve accuracy for Gemini is now making its testers evaluate responses even if they don't have the "domain knowledge."
SEE ALSO: Google adds Deep Research to Gemini for browsing the web on your behalfThe report raises questions about the rigor and standards Google says it applies to testing Gemini for accuracy. In the "Building responsibly" section of the Gemini 2.0 announcement, Google said it is "working with trusted testers and external experts and performing extensive risk assessments and safety and assurance evaluations." There's a reasonable focus on evaluating responses for sensitive and harmful content, but less attention is paid to responses that aren't necessarily dangerous but just inaccurate.
Google seems to disregard the hallucination and error problem by simply adding a disclaimer that "Gemini can make mistakes, so double-check it," which effectively absolves it from any responsibility. But that doesn't account for the humans doing the work behind the scenes.
Previously GlobalLogic, a subsidiary of Hitachi, instructed its prompt engineers and analysts to skip a Gemini response they didn't fully understand. "If you do not have critical expertise (e.g. coding, math) to rate this prompt, please skip this task," said the guidelines viewed by the outlet.
But last week, GlobalLogic changed its instructions, saying, "You should not skip prompts that require specialized domain knowledge," and to instead "rate the parts of the prompt you understand," and note that they don't have the required expertise in their analysis. Expertise, in other words, is not being treated as a prerequisite for this work.
Contractors can now only skip prompts that are "completely missing information," according to TechCrunch, or those that contain sensitive content that requires a consent form.
Topics Artificial Intelligence Google
Previous:An Uneven Disaster
Next:Boys to Men
If Steve Jobs was still alive he'd totally be wearing this 3Amazon might update Alexa with voice recognitionBBC documentary creates a stir, India bans channel from filming in tiger reservesJohn Oliver 'accidentally eviscerates' Trevor Noah as guest on 'The Daily Show''Hearthstone: Journey to Un'Goro' expansion bringing 135 new cards in AprilNew Lego set blasts off to space with an allYouTube just hit a huge milestone'Get Out' finally got a negative review and it's from exactly who you'd expectWhy Kellyanne Conway was on the couch and oh lord this is so dumbIf Steve Jobs was still alive he'd totally be wearing this 3Bill Gates' latest Reddit AMA is unintentionally hilariousNFL players may seem tough, but they can't hang with these really bad jokesTwitch will let streamers sell games, raising loads of ethical questionsBill Nye is only taking selfies with climateTrump is low key taking credit for the Oscars flub because of course he isMahershala Ali is the first Muslim actor to win an OscarIrritated elephant chucks a tree branch at a JeepYouTube just hit a huge milestoneChrissy Teigen makes sure everyone knows John Legend didn't win an Oscar (this year)Move over Emily Dickinson, Grindr has a poet in residence NFL QB Andrew Luck is retiring and hey, let's focus on the nice stuff Chrissy Teigen once again uses stretch marks to remind us that she's normal Teacher's pets are cool, just ask all your favorite high school movies New RadRunner e New Alexa smart speaker skill plays music for your dog Instagram is obsessing over these delicate flower Forget range anxiety, this couple drove across the country in a Tesla Australian strangers start elaborate feud over coffeeshop fandom 'The OA' fans built a website to celebrate the canceled Netflix series Obama's final tweets as president are a message of strength and hope Review: FORM swim goggles track your data like an underwater coach Christina Hendricks revealed she was hand model for 'American Beauty' 'Control' review: A trippy mystery from the team behind 'Alan Wake' Fall movie preview 2019: 6 horror films to watch Netflix makes it easier to find new and upcoming movies and shows This man wants to make dating great again for Trump supporters 14 times J.K. Rowling absolutely annihilated Donald Trump on Twitter Shocking 'Star Wars: The Rise of Skywalker' footage unveiled at D23 Uber will pay $20 million to settle charges that it misled drivers about pay Taylor Swift 'Lover' album review: A dreamy, thrilling adventure
2.4128s , 10106.71875 kb
Copyright © 2025 Powered by 【En la intimidad】,Information Information Network