AI tests into top 1% for original creative thinking

Date:
July 5, 2023
Source:
The University of Montana
Summary:
New research suggests artificial intelligence can match the top 1%
of human thinkers on a standard test for creativity.


Facebook Twitter Pinterest LinkedIN Email

==========================================================================
FULL STORY ==========================================================================
New research from the University of Montana and its partners suggests artificial intelligence can match the top 1% of human thinkers on a
standard test for creativity.

The study was directed by Dr. Erik Guzik, an assistant clinical professor
in UM's College of Business. He and his partners used the Torrance
Tests of Creative Thinking, a well-known tool used for decades to assess
human creativity.

The researchers submitted eight responses generated by ChatGPT, the
application powered by the GPT-4 artificial intelligence engine. They
also submitted answers from a control group of 24 UM students taking
Guzik's entrepreneurship and personal finance classes. These scores
were compared with 2,700 college students nationally who took the TTCT
in 2016. All submissions were scored by Scholastic Testing Service,
which didn't know AI was involved.

The results placed ChatGPT in elite company for creativity. The AI
application was in the top percentile for fluency -- the ability to
generate a large volume of ideas -- and for originality -- the ability to
come up with new ideas. The AI slipped a bit -- to the 97th percentile --
for flexibility, the ability to generate different types and categories
of ideas.

"For ChatGPT and GPT-4, we showed for the first time that it performs
in the top 1% for originality," Guzik said. "That was new." He was
gratified to note that some of his UM students also performed in the
top 1%. However, ChatGTP outperformed the vast majority of college
students nationally.

Guzik tested the AI and his students during spring semester. He was
assisted in the work by Christian Gilde of UM Western and Christian
Byrge of Vilnius University. The researchers presented their work in
May at the Southern Oregon University Creativity Conference.

"We were very careful at the conference to not interpret the data very
much," Guzik said. "We just presented the results. But we shared strong evidence that AI seems to be developing creative ability on par with or
even exceeding human ability." Guzik said he asked ChatGPT what it would indicate if it performed well on the TTCT. The AI gave a strong answer,
which they shared at the conference: "ChatGPT told us we may not fully understand human creativity, which I believe is correct," he said. "It
also suggested we may need more sophisticated assessment tools that can differentiate between human and AI-generated ideas." He said the TTCT is protected proprietary material, so ChatGPT couldn't "cheat" by accessing information about the test on the internet or in a public database.

Guzik has long been interested in creativity. As a seventh grader growing
up in the small town of Palmer, Massachusetts, he was in a program
for talented-and- gifted students. That experience introduced him to
the Future Problem Solving process developed by Ellis Paul Torrance,
the pioneering psychologist who also created the TTCT. Guzik said he
fell in love with brainstorming at that time and how it taps into human imagination, and he remains active with the Future Problem Solving
organization -- even meeting his wife at one of its conferences.

Guzik and his team decided to test the creativity of ChatGPT after
playing around with it during the past year.

"We had all been exploring with ChatGPT, and we noticed it had been doing
some interesting things that we didn't expect," he said. "Some of the
responses were novel and surprising. That's when we decided to put it
to the test to see how creative it really is." Guzik said the TTCT test
uses prompts that mimic real-life creative tasks. For instance, can you
think of new uses for a product or improve this product? "Let's say
it's a basketball," he said. "Think of as many uses of a basketball
as you can. You can shoot it in a hoop and use it in a display. If you
force yourself to think of new uses, maybe you cut it up and use it as
a planter. Or with a brick you can build things, or it can be used as
a paperweight. But maybe you grind it up and reform it into something completely new." Guzik had some expectation that ChatGPT would be good
at creating a lot of ideas (fluency), because that's what generative AI
does. And it excelled at responding to the prompt with many ideas that
were relevant, useful and valuable in the eyes of the evaluators.

He was more surprised at how well it did generating original ideas,
which is a hallmark of human imagination. The test evaluators are given
lists of common responses for a prompt -- ones that are almost expected
to be submitted.

However, the AI landed in the top percentile for coming up with fresh responses.

"At the conference, we learned of previous research on GPT-3 that was
done a year ago," Guzik said. "At that time, ChatGPT did not score
as well as humans on tasks that involved original thinking. Now with
the more advanced GPT-4, it's in the top 1% of all human responses."
With AI advances speeding up, he expects it to become a key tool for the
world of business going forward and a significant new driver of regional
and national innovation.

"For me, creativity is about doing things differently," Guzik
said. "One of the definitions of entrepreneurship I love is that to be
an entrepreneur is to think differently. So AI may help us apply the
world of creative thinking to business and the process of innovation,
and that's just fascinating to me." He said the UM College of Business
is open to teaching about AI and incorporating it into coursework.

"I think we know the future is going to include AI in some fashion,"
Guzik said. "We have to be careful about how it's used and consider
needed rules and regulations. But businesses already are using it for
many creative tasks. In terms of entrepreneurship and regional innovation,
this is a game changer."
* RELATED_TOPICS
o Mind_&_Brain
# Creativity # Intelligence # Educational_Psychology #
Perception
o Computers_&_Math
# Artificial_Intelligence # Educational_Technology #
Neural_Interfaces # Encryption
* RELATED_TERMS
o Mensa_International o Aptitude o Artificial_intelligence o
Gifted_education o Computer_vision o Intelligence_quotient o
Cognition o Bioinformatics

==========================================================================

Print

Email

Share ========================================================================== ****** 1 ****** ***** 2 ***** **** 3 ****
*** 4 *** ** 5 ** Breaking this hour ==========================================================================
* Why_Birds_Ancestors_Lived;_Other_Dinosaurs_Died *
Dissolving_Cardiac_Device_Treats_Heart_Disease *
Webb_Locates_Dust_Reservoirs_in_Two_Supernovae *
Earth_Formed_from_Dry,_Rocky_Building_Blocks *
Ancient_Volcanic_Activity_On_Moon's_Dark_Side *
Highly_Conductive_Metallic_Gel_for_3D_Printing *
Potent_Greenhouse_Gas_Could_Be_Abated_Today *
Polymer_Brains_for_Artificial_Neural_Networks *
Early_Apex_Predator_Sought_Soft_Over_...

* Time_in_Universe_Once_Flowed_Five_Times_Slower

Trending Topics this week ========================================================================== HEALTH_&_MEDICINE Fitness Genes Cholesterol MIND_&_BRAIN Child_Psychology Creativity Educational_Psychology LIVING_&_WELL Fitness Healthy_Aging Staying_Healthy


==========================================================================

Strange & Offbeat ========================================================================== HEALTH_&_MEDICINE Grocery_Store_Carts_Set_to_Help_Diagnose_Common_Heart_Rhythm_Disorder_and Prevent_Stroke DNA_Can_Fold_Into_Complex_Shapes_to_Execute_New_Functions Everyone's_Brain_Has_a_Pain_Fingerprint_--_New_Research_Has_Revealed_for_the First_Time MIND_&_BRAIN
AI_Tests_Into_Top_1%_for_Original_Creative_Thinking Scientists_Discover_Spiral-Shaped_Signals_That_Organize_Brain_Activity Illusions_Are_in_the_Eye,_Not_the_Mind LIVING_&_WELL AI_Tests_Into_Top_1%_for_Original_Creative_Thinking Amputees_Feel_Warmth_in_Their_Missing_Hand Why_Do_Champagne_Bubbles_Rise_the_Way_They_Do?_Scientists'_New_Discovery_Is Worthy_of_a_Toast Story Source: Materials provided by The_University_of_Montana. Original written by Cary Shimek. Note:
Content may be edited for style and length.


==========================================================================


Link to news story: https://www.sciencedaily.com/releases/2023/07/230705154051.htm

--- up 1 year, 18 weeks, 2 days, 10 hours, 50 minutes
* Origin: -=> Castle Rock BBS <=- Now Husky HPT Powered! (1:317/3)