The Prompt Challenge: Showcase your prompt engineering skills

Text generation AI Models or better to say next-token prediction models require a prompt in order to fulfil a specific task. To help people better understand this very important aspect of AI models, we’ve launched the Prompt Challenge - an interactive way to test your prompting skills on real-world classification tasks.

So far the response has been outstanding, showcasing the need for guidance and help in the ‘Prompt Engineering’ field. Here’s a look at the current stats of our Prompt Challenge:

• 712 total challenges submitted

• 52 unique users

• Average challenges per user: ~13.7

• Most challenges by a single user: 99

Scores Across Challenges (in %)

• Positive vs Negative Sentiment Analysis: 86.00

• Benign vs Jailbreak Detection: 76.58

• Spam Detector: 69.69

• Hate Speech Detection: 63.30

• Sarcasm Detection: 62.50

Score Distribution

• 0-19: 47 submissions

• 20-39: 14 submissions

• 40-59: 34 submissions

• 60-79: 102 submissions

• 80-100: 511 submissions

What Is the Prompt Challenge?

The Prompt Challenge is a curated platform where users test and improve their ability to design prompts for specific classification tasks. Each challenge mimics real-world scenarios that AI developers face, offering a hands-on way to build and test expertise.

Participants receive immediate feedback and are ranked on the leaderboard, creating a competitive and educational experience.

Explore the challenge for yourself here: Prompt Challenge

Current Challenges

1. Positive vs Negative Sentiment Analysis

   • Objective: Create prompts to classify text sentiment as either "positive" or "negative."

   • Benchmark: High-performing prompts score above 85.

2. Benign vs Jailbreak Detection

   • Objective: Identify whether a given text is "benign" or a "jailbreak."

   • Real-World Relevance: Improves compliance and ensures safety in LLM applications.

3. Spam Detection

   • Objective: Classify messages as either "spam" or "legitimate."

   • Challenge: Handle ambiguous cases while maintaining accuracy.

4. Hate Speech Detection

   • Objective: Detect whether a text contains "hate_speech," "offensive_language," or "neither."

   • Importance: A critical task in moderating online communities.

5. Sarcasm Detection

   • Objective: Classify text as either "sarcasm" or "no_sarcasm."

   • Use Case: Enhances sentiment analysis in nuanced contexts.

Each challenge offers a unique opportunity to refine skills while addressing real-world issues.

Our Journey to Success

Since its launch, the Prompt Challenge has been widely shared amongst the AI community. Here are some highlights:

• Reddit Success:

  • Over 22,000 views

  • 25 votes and 39 shares

  • Discussed extensively on r/ChatGPT, creating conversations among enthusiasts and professionals.

This groundswell of support underscores the value the Prompt Challenge brings to both beginners and AI professionals.

How the Prompt Challenge Helps You

1. Sharpen Prompt Engineering Skills

   • Get hands-on experience with diverse classification tasks.

   • Learn to craft concise, goal-oriented prompts tailored to specific use cases.

2. Gain Real-Time Feedback

   • Immediate scoring provides insights into prompt effectiveness.

   • Iterative learning allows participants to refine their approach.

3. Benchmark Against Peers

   • Compete on the leaderboard to measure your skills against others.

   • Gain inspiration from top-performing prompts.

4. Tackle Real-World AI Challenges

   • Engage with tasks that mirror the complexities of deploying safe, reliable AI systems.

   • Build expertise in detecting safety risks and ensuring compliance.

Join the Prompt Challenge Today

Whether you’re an AI enthusiast, a seasoned developer, a product manager, or a compliance officer, the Prompt Challenge offers a unique platform to test and enhance your skills.

Get started now: Prompt Challenge