Read 1685 times

  • waygo0k
  • The Legend

    • 4825

    • September 27, 2011, 11:51:01 am
    • Chungnam
Re: AI use in education
« Reply #20 on: November 14, 2023, 04:00:16 am »
That is where knowing your students comes in.  If a student submits AI generated content for their EE  (or their IA), it’s fairly easy to sus out in my subject, and even easier to pick up since I know that student and what they’re capable of academically.

The rate of false positives is way too high for accusations and bad grades to be thrown around aimlessly.

I would rather give feedback on where I’ve caught them out and what they can do to rectify the situation. That’s why failsafes like the engagement criterion (and regular checkins) come in in the EE.

Moreover as you said, IB allows students to use AI generated content as long as it is cited properly. Just because students get banned from using AI in one stage of their lives, doesn’t mean they’ll keep using it simultaneously in other stages and even future stages. Banning it is a losing battle.


  • Aniki
  • Super Waygook

    • 296

    • October 02, 2023, 12:11:11 pm
    • China
    more
Re: AI use in education
« Reply #21 on: November 16, 2023, 11:55:53 am »
That is where knowing your students comes in.  If a student submits AI generated content for their EE  (or their IA), it’s fairly easy to sus out in my subject, and even easier to pick up since I know that student and what they’re capable of academically.

The rate of false positives is way too high for accusations and bad grades to be thrown around aimlessly.

The rate of false negatives is fairly high, but the rate of false positives is low enough to make an accusation, especially after the update last May. If turnitin shows several several sentences in a row as AI-generated, the chance that is isn't AI-generated is negligible. You can take a look at Phoenix Storm's blog thread. I put a bunch of his articles through turnitin and most of them range from 50% to 100% AI-generated. False positives happen but they are easy to spot because they appear randomly throughout a text. And giving a student a bad grade for submitting obviously AI-generated content isn't "aimless." It teaches them that their actions have consequences and deters future academic dishonesty.

Quote
I would rather give feedback on where I’ve caught them out and what they can do to rectify the situation. That’s why failsafes like the engagement criterion (and regular checkins) come in in the EE.

Moreover as you said, IB allows students to use AI generated content as long as it is cited properly. Just because students get banned from using AI in one stage of their lives, doesn’t mean they’ll keep using it simultaneously in other stages and even future stages. Banning it is a losing battle.

I think IBO jumped the gun and messed up big time. They announced it a few weeks after ChatGPT was released because they wanted to be cool and modern. They didn't predict that countermeasures would be deployed so quickly and as a result they've massively cheapened the things that gave their curriculum an advantage. They also didn't understand what generative AI is. Strictly speaking, it isn't a "source" and will make up fake information to satisfy a prompt. The search results can't necessarily be truly verified by the marking team because they're too unstable.


  • sleepy
  • Veteran

    • 236

    • April 02, 2013, 03:05:44 pm
Re: AI use in education
« Reply #22 on: November 16, 2023, 01:01:08 pm »
Oh, Minjoo, your midterm paper on Asian economic theory was truly a masterpiece. I mean, who wouldn't be impressed by your profound insights and groundbreaking analysis? It's almost like you single-handedly revolutionized the entire field of economics in one semester. And let's not forget your growing academic independence – it's truly awe-inspiring how you've managed to navigate the treacherous waters of midterms without needing a GPS in the form of guidance from your teachers or Chat GPT.

You laugh in the face of our institutions attendance policy, but yet somehow manage to produce Elon Musk'esk results in your exams.

Bravo, Minjoo, bravo.

Your independence is shining brighter than a supernova in the academic galaxy.



  • waygo0k
  • The Legend

    • 4825

    • September 27, 2011, 11:51:01 am
    • Chungnam
Re: AI use in education
« Reply #23 on: November 20, 2023, 02:00:24 pm »
I don't think IBO jumped the gun. They saw the forest for the trees and clearly understood AI is a technology that is here to stay. It's kind of like saying we should ban internet sources because students will just copy and paste from websites...AI will eventually be as ubiquitous as the internet, so why not encourage and foster its proper usage the same way we do for online sources in education?

IMO the organisations that jumped the gun are the ones who acted in a reactionary manner and banned the use of AI for assessments...might as well just ban the use of internet resources and electronic devices altogether and go back to classic penmanship under direct supervision.

Students have been skirting the rules around plagiarism and academic honesty since the beginning of education...we've learned that prohibition rarely works especially in cases where the thing you are trying to prohibit is widely available at little to no cost...but now we're supposed to believe by simply declaring AI as unwelcome in academia its use will suddenly go away?


  • 745sticky
  • The Legend

    • 2834

    • March 26, 2020, 01:52:57 pm
    • Korea
Re: AI use in education
« Reply #24 on: November 20, 2023, 02:14:13 pm »
I don't think IBO jumped the gun. They saw the forest for the trees and clearly understood AI is a technology that is here to stay. It's kind of like saying we should ban internet sources because students will just copy and paste from websites...

AI will eventually be as ubiquitous as the internet, so why not encourage and foster its proper usage the same way we do for online sources in education?


false equivalence. the internet is a tool, it can be used for any number of things. same can't be said for AI, at least from what i've seen.

what's an example of "proper usage" of AI related to academics?




  • Aniki
  • Super Waygook

    • 296

    • October 02, 2023, 12:11:11 pm
    • China
    more
Re: AI use in education
« Reply #25 on: November 21, 2023, 11:28:52 am »
I don't think IBO jumped the gun. They saw the forest for the trees and clearly understood AI is a technology that is here to stay. It's kind of like saying we should ban internet sources because students will just copy and paste from websites...AI will eventually be as ubiquitous as the internet, so why not encourage and foster its proper usage the same way we do for online sources in education?

IBO absolutely jumped the gun. They released their guidelines weeks after ChatGPT was released. Their guidelines are not "proper use" at all. "It's ok to use ChatGPT as long as you cite it"? What if ChatGPT is dead wrong about something, or the assessors can't reproduce the prompt results? I very much doubt if IBO considered this.

Quote
IMO the organisations that jumped the gun are the ones who acted in a reactionary manner and banned the use of AI for assessments...might as well just ban the use of internet resources and electronic devices altogether and go back to classic penmanship under direct supervision.

This is the direction a lot of schools are now going in. I'd do it if I had the class time, but for now I'm collecting work digitally and putting it all through turnitin. It's accurate enough to be a deterrent if you understand how false positives express themselves.

Quote
Students have been skirting the rules around plagiarism and academic honesty since the beginning of education...we've learned that prohibition rarely works especially in cases where the thing you are trying to prohibit is widely available at little to no cost...but now we're supposed to believe by simply declaring AI as unwelcome in academia its use will suddenly go away?

This is why academic honesty policies have such low levels of tolerance. It might be unlikely for a student to get caught on any one given assignment, but if he/she violates the academic honesty policy on all his/her work, he/she will inevitably get caught some day. Even if you pay someone to write your essay for you, chances are that person also plagiarized at least some of it. As an aside, given the news as of late I doubt if ChatGPT can continue to be made available for free indefinitely. It isn't a magic tool bestowed on us by heaven. It's very resource-intensive to run and will have to start making money some day.


  • waygo0k
  • The Legend

    • 4825

    • September 27, 2011, 11:51:01 am
    • Chungnam
Re: AI use in education
« Reply #26 on: November 21, 2023, 06:33:09 pm »

false equivalence. the internet is a tool, it can be used for any number of things. same can't be said for AI, at least from what i've seen.

what's an example of "proper usage" of AI related to academics?




AI has been a tool that has been used for decades now...what we know as chatgpt is just one form of one of the latest versions of AI. All those google searches you've been making all these years have involved the use of AI some form or another.

IBO absolutely jumped the gun. They released their guidelines weeks after ChatGPT was released. Their guidelines are not "proper use" at all. "It's ok to use ChatGPT as long as you cite it"? What if ChatGPT is dead wrong about something, or the assessors can't reproduce the prompt results? I very much doubt if IBO considered this.

You're making the big assumption that IB did not know of chatgpt a week before it was released. I'm willing to bet they've been aware of it and other chatgpt equivalents for years throughout the development stages...remember each IB subject often has input from many of the top experts in their field of study.

This is the direction a lot of schools are now going in. I'd do it if I had the class time, but for now I'm collecting work digitally and putting it all through turnitin. It's accurate enough to be a deterrent if you understand how false positives express themselves.

Turnitin itself is a type of AI that has been in use for decades now.

This is why academic honesty policies have such low levels of tolerance. It might be unlikely for a student to get caught on any one given assignment, but if he/she violates the academic honesty policy on all his/her work, he/she will inevitably get caught some day. Even if you pay someone to write your essay for you, chances are that person also plagiarized at least some of it. As an aside, given the news as of late I doubt if ChatGPT can continue to be made available for free indefinitely. It isn't a magic tool bestowed on us by heaven. It's very resource-intensive to run and will have to start making money some day.

This I agree with and is why I always remind my students they won't have chatgpt/google or any other form of AI in their exams. For those who insist on rolling the AI dice for their essay/report-type assessments, I also remind them that a) they WILL eventually get caught and b) what do they have planned for WHEN they do get caught.

Universities are starting to realise the futility of AI detection software...and these aren't small players


  • 745sticky
  • The Legend

    • 2834

    • March 26, 2020, 01:52:57 pm
    • Korea
Re: AI use in education
« Reply #27 on: November 22, 2023, 08:01:31 am »
AI has been a tool that has been used for decades now...what we know as chatgpt is just one form of one of the latest versions of AI. All those google searches you've been making all these years have involved the use of AI some form or another.

ah, my mistake. for some reason i thought you actually had something to say on the subject at hand, didn't think you were just being pedantic  :undecided: