Applied AI Engineer to take a 60-minute Quala assessment and give feedback
python, machine-learning, javascript
Preferred qualifications
- Experience: Expert
We are an early-stage software startup hiring a Founding Applied AI Engineer. Before we use a technical assessment to screen candidates, we want to test the Quala assessment platform, and we want an experienced engineer to take it and tell us honestly how well it works.
What you will do:
- Complete one timed, 60-minute Quala assessment for the Applied AI Engineer role, as if you were a real candidate applying for the job. Please treat it the way you would treat a real application: do your honest best work, within the time limit.
- The link and instructions are shared after you accept the job.
- Complete the assessment within 24 hours of accepting the job.
- Answer the feedback questions below in a written message when you submit.
Total time is about 90 minutes: the 60-minute assessment plus about 20-30 minutes to write your feedback. This is a fixed payment of $50 for the full task.
Feedback questions (a short answer to each is fine; a 1-5 rating plus one or two sentences works well):
1. Ease of use: How easy was it to start, navigate, and submit? Any bugs, confusing screens, or friction?
2. Instructions: How clear were the instructions and expectations?
3. Realism: How closely did the tasks reflect real applied AI work (LLM features, evaluation, retrieval, agents)?
4. Skill measurement: Did it let you show your real ability? What would it miss, or reward that it should not?
5. Fairness and gameability: Was anything ambiguous, unfair, too easy, too long, or easy to game (for example, by simply prompting an LLM)?
6. Time and pressure: Did the 60-minute limit and format feel right?
7. Candidate experience: Would you be comfortable taking this for a real job you wanted? Anything intrusive or off-putting (for example, proctoring, camera, or screen recording)?
8. Overall: Would you trust this assessment to identify strong candidates for this role? Why or why not?
9. If you could change one thing about the platform, what would it be?
What we are looking for:
- Hands-on experience shipping LLM-based or machine learning features (Python, LLM APIs, evaluation, retrieval or agents).
- Clear, candid written communication.
- Availability to complete the assessment within 24 hours of accepting.
We will keep the assessment confidential. Please do not share or reuse it.
In your proposal, briefly tell us about your relevant experience.
Open job
AI proposal draft
Generate a short cover letter to copy into the offer. Says you are interested and ready to work.
Sign in to generate an AI proposal draft.
Log in