In this post I will discuss some common issues that new raters face. If you have other issues, feel free to share by leaving a comment below.
What kind of tasks to expect while providing search engine evaluation service for Appen/Lionbridge?
If you get a position as a search engine rater with Appen or Lionbridge (Internet Assessor), you may encounter many different tasks. Some of these tasks are your normal rating tasks, and some are side by side, and you may even run into all kinds of experimental tasks. Some of the tasks are easier than others, like experimental tasks. Each task has a different set of instructions, so it’s best to make sure you know exactly what you are doing, and read very carefully each of the task instructions.
Yukon Project Side By Side tasks
Side by Side rating tasks are very interesting and have everything to do with Google algorithm changes. The human role or ‘rating’ in Side By Side tasks is to determine which side, left or right, is better than the other. In this task you are shown blocks on the left and right side. Each block has a slider from Fails to Meet to Fully Meets, and you should choose which one is best for each block depending on the user intent and query. The same guidelines apply for the blocks as they would for a page rating. Meaning that if block meets user intent, it should get the appropriate rating. Once you have chosen the ratings for each block, you will then be asked to choose on a scale which side is better than the other. A comment may be required to give your own opinion on why you’ve chosen which side, and why it is the best over the other side. It’s very important that you base all your ratings on user intent and taking their location in mind. You will also have a quality review on Side by Side tasks once in two months.
Yukon Project Page Quality tasks
This is the main rating task that a rater is hired to rate. You will be given a website URL along with the first 5 questions which check things like foreign language, which if you’re doing English/USA ratings, would need to be in English to be understood from your location. Pages that don’t load need to be checked, as well as flagging for porn.
The second question is asking you to describe the purpose of the page. The purpose of the page and the user intent are entirely different aspects. Make sure you’re checking the website out to see if it matches user intent, and by looking at the website, you should be able to understand what its main purpose is. If the page is malicious, harmful, or just lacks its purpose for what it is searched for, then you should mark that here. Pages that are simply existing to show ads, without any help to the user, should be flagged. And lastly, it is important to make sure that you understand if the page is a YMYL (Your money or your life) webpage. Understanding this is important because it will change the overall rating of the website.
Once you have completed this, you will then rate the different aspects of the page including its main content quality, and the amount of content. Expertise, authority, and trustworthiness, who is responsible for the website, the supplementary content, page design, layout, and website care and maintenance are all graded on a scale from lowest to highest. The last thing to do is to give the website its overall rating. Usually these types of tasks are allowed 9 minutes to complete. A quality review is done each month to see how you rate. So it’s important to make sure that you are taking the time to evaluate each website properly.
Appen Yukon and Lionbridge Internet Assessor Needs Met tasks
This type of tasks you have already saw while doing part 3 of the qualification exam. Each task contains 8-12 result blocks. In each task you will be given a certain query, and a list of search results blocks with links where you have to give a usefulness rating to search results using a scale from ‘Fails to Met’ to ‘Fully Met’
Other Experimental tasks
Sometimes during rating of side by side, you will see experimental tasks pop up. In most cases experimental tasks are standard page quality or need met tasks, but sometimes you will get new types of tasks. Experimental tasks have a wide range of instructions. It’s important to read the instructions for each task as they will be different each time. Experimental tasks can be very simple, or take a few minutes to complete. They are not always available, and each task can be completely different than the other.
Task Comments
A wide variety of tasks require comments; others do not require comments but give you the option to leave them. While it may seem like comments just put time pressure on you and end up disappearing into a black hole. Your comments help Google analysts understand how you interpret queries and the logic behind your ratings.
Additionally, while block-level comments are not required, they can make Google aware of different experiences raters may have had with a result.
The more information we have the better, so please make sure your comments provide an appropriate amount of information. Here are some basic guidelines for common types of required comments:
- SXS comments always need to include what you think the user intent is, which results are good/bad and why that is, and what led you to prefer one side over another.
- PQ comments should not just repeat grid contents (“All the characteristics in the PQ grid are high, so the overall page quality is High too”) – rather, they should explain why a page’s reputation/EAT/MC/SC/etc. are good/bad and why, giving a more step-by-step walkthrough of why you gave a particular PQ rating.
Appen Yukon Project quality feedback & Lionbridge internet assessor monthly quality review
New raters should not do live tasks immediately after getting access to the task portal. It is highly advised that you hold off on rating live tasks if you do not want to be restricted for quality in the next month. Typically tasks which are available for new raters are quality review tasks on which raters are accessed for their quality. Instead, new raters should focus on doing simulation tasks and self-education. Time spent doing this will really pay off, and you wont be restricted for quality in the future. Also, by doing a certain number of simulation tasks correctly you will upgrade your status in the system, and will be allowed to work more hours.
During your participation in the project your service will be evaluated for its quality by means of quality review tasks. In the beginning of every month, a certain number of tasks are uploaded into the system. Normally there are 10-12 tasks of Needs Met or Side by Side, and once in 3 months PQ tasks to be released as quality review tasks. These tasks are quality review tasks up on which your quality is measured every month, in the end of the month you will get your quality score feedback. In case of raters get substandard quality for several consecutive months, most likely such raters will be removed from the rating program.
If your ratings often stand out of general range of ratings provided by other raters in the project, most likely your account will be flagged by the system automatically and your work will be checked manually for quality .
Read more about this topic here:
How to Work at Lionbridge and Appen For a Long Time and Not Get Fired?
recording and invoicing Working time Yukon and Lionbridge internet assessor project
Time management (recording and invoicing working time) of the work you complete can become a problem if you aren’t managing how much time you are spending on tasks. First of all, you should not sacrifice quality for time. In the beginning you may spend more time than the average estimated time (AET) that Appen or Lionbridge allocate to a specific task, but make sure that in the invoice you put average estimated time that they give you. If you spend less time than average estimated time per a task or set of tasks, be informed that your invoice will be returned for correction, Appen and Lionbridge will ask you to put actual time spent, that is why there is no sense to complete tasks faster than average estimated time. Take your time, do everything correctly and watch your time.
the Yukon Project Extension
Do not forget to log on to the Yukon extension each time you work in the system, otherwise your time spent on doing tasks will not be paid.
According to the vendor policy: any time spent logging on/off, reading, studying, and break times are not billable. Any tasks that are not submitted or are released are also not billable. Please make sure you are not including any of this time on your invoice.
Also keep in mind that consecutive invoices submitted with productivity below 100% may result in removal from the project or you may lose your contract with Appen.
Productivity and Average Estimated Time (AET)
When it comes to the time spent working on a task, the listed AET is meant to represent the average amount of time that a task is expected to take. In general, it is best to complete tasks near the given AET, but we understand that some tasks may take a bit longer than others. If more time is needed to complete a task, we encourage you to take it within reason. The overall goal is to complete tasks within 10% of the given AET. When productivity falls below 90%, a Low Productivity Notice is typically sent out.
Appen Yukon project Invoice Returned for Missing or Incorrect Data
Lots of new raters receive the following emails from vendors:
Your invoice has been rejected for missing or incorrect data. Please make the necessary corrections or provide specific details on the reason for each discrepancy.
Time Discrepancy: For the following line item(s) there is a discrepancy between the hours you have submitted and the activity and work recorded on our servers.
Reported: x hours, xx mins
Unaccounted Variance: -xx mins
What raters should do in this situation?
In order to get invoice approved, raters have to deduct xx unaccounted variance minutes from the invoice, in the future make sure only AET is entered into invoice and the Yukon extension has to be on during active rating.
Payment method for Appen, Lionbridge and Raterlabs
HOW to add Already existing Payoneer account at appen connect personal project page
How to earn additional 25$ by signing up to Payoneer via RefeRral Link
Appen Yukon get locked or restricted for Productivity
Working on some tasks much faster than the AET followed by holding on to a task for much longer than the AET and billing for the full amount on your invoice
Raters are allowed to bill for the AET of a task OR the actual time spent working, whichever is less of the two amounts. It has been discovered that some raters working some tasks much faster than the AET followed by holding on to a task for much longer than the AET and billing for the full amount on invoice, which is a violation of official policy and will not be tolerated.
For example: Rater works 5 tasks, each with an AET of 5 minutes. The first 4 tasks rater completes in 1 minute each, and the 5th task rater holds on to for 30 minutes.
If this pattern continues, invoices will be rejected and raters will be removed from the rating program. Be sure that all invoices are in compliance with policy.
Appen Yukon & Lionbridge project multi-accounts
According to Appen Yukon project policy you can only have one account per IP address, while Lionbridge allows to have one account per household. Those pretty much mean the same thing. There can’t be two accounts coming from the same internet service and this requirement come from Google system requirements.
When it comes to Google rating projects or Facebook related projects, Appen and Lionbridge can find duplicate accounts very fast, and as a result, you will end up losing your accounts and they will be terminated. You certainly don’t want that to happen.
Be informed that it is prohibited to have multiple accounts, without special arrangement. Appen and Lionbridge can find duplicate accounts very fast, and as a result, you will lose both accounts.
There are a few things you can do to get around this problem, and arrange them in way that Leapforce, Lionbridge, and Appen won’t be able to detect.
IP address change and network sharing while working in Appen Yukon and Lionbridge projects
In some cases people may share their network, while working as search engine evaluator, this case leads to IP address conflict and removal from the project. Make sure that you have your personal unique IP address and no one uses the same IP to go online for rating project.
When rating tasks on raterhub platform you may change your IP address many times, it will not affect your project status. Make sure that you do your project tasks in a private place and in a country of your project locale.
Non-completion of a minimum required number of tasks
This issue is very common among new Appen Yukon project agents and may lead to termination of contract. This happens when new agents show no activity in the first month of service. In particular, this can happen if new agents enter the project in the second half of month, and for whatever reasons, they did not complete a minimum required number of tasks. In order to avoid this issue, make sure to show the minimum required activity in the raterhub system.
Yukon and Lionbridge project tasks availability and new rater time restriction
In general, Appen and Lionbridge guarantee at least 2 hours of work per day but task availability may depend on project locale. There might be some days when tasks are available for more than 4 hours. Some locales, like the US project provides raters with 24 hrs/7 days tasks availability.
For the rest market task availability may be limited. You should understand that the system of task distribution is based on a ‘first come first served’ basis and you need to be ready to catch your portion of tasks when they are uploaded into the system. In order to identify time slots when task availability is the highest please look at task completion graph, usually tasks are uploaded every day into the system at the same time slots.
Lionbridge does not provide raters with a task availability instrument, so raters have to identify time slots when tasks are uploaded into the system by themselves.
Appen also has a system that restricts access to tasks for new raters, and those who are undergoing their quality review. To lift this restriction, you have to complete a certain number of simulation tasks or wait till the next quality review, if your quality score is good, the restriction will be lifted automatically.
Appen Yukon and Lionbridge raters get locked for quality audit or restricted for quality
If you receive an email notifying you that your account has been placed under quality review, this is a good time to identify your weak points and improve your rating skills. Below you will find some tips on how to deal with a “Locked for quality audit” situation.
- To speed up the process and to get feedback on your mistakes as quickly as possible, I recommend writing to your vendor and ask why exactly your account has been placed under review. Sometimes the automatic system locks raters accounts without specific reasons. Usually such cases are being resolved within 1-2 days.
- While waiting for detailed feedback from your vendor, proceed with doing simulation tasks in order to improve your rating skills. In most cases the issue is related to Side by Side tasks. Make sure that you understand how to deal with this type of task and that you provide well written comments where required. In many cases, raters are placed under quality review due to poorly written comments.
- Once you receive the feedback email with your mistakes/quality issues, read it carefully and reply back with an explanation on how you will improve your weak points.
- Once your status is moved to “Restricted for quality”, keep in mind that your service is under inspection, thus making sure that you do your best to provide the best possible service.
Appen yukon raters hold status restricted for quality after receiving meets expectations quality feedback
Sometimes some raters do not get their restricted status changed to unrestricted with getting a meets expectations or above quality score. This happens because they were restricted for side by side or PQ tasks quality issues and feedback was released for needs met tasks. In order to lift up all restrictions a rater will have to wait for the next quality review cycle for type of tasks a rater was initially restricted for. If you get meets expectations or an above quality score your account will be unrestricted again.
Have you ever wondered how many hours raters work?
Knowing these statistics can be useful for raters in terms of estimating possible productivity .
The survey is completely anonymous and once completed will show the overall statistics.
Thanks for participating!
Thank you very much!!! for all your help and responding so quickly to all of my many questions. I would not have been so successful at this job without your help ! I will recommend you to anyone I know who is in need of assistance.
Extremely valuable information in one source! Saved a lot of time searching the net, as all the info one needs is in one location. Thank you very much.
Tim was a lifesaver. I passed the leapforce exam all because of him. I trust him with any advice or recommendations that he makes. I assure all of you 100% to all those that use his services that he will help you pass the exam and assist you in many other ways to keep your employment and profile with leapforce or lionbridge active.
I recently got an offer from lionbridge, although I still have to take the exam. When I told my boyfriend he said he looked into it to make some extra money but it’s limited to one account per IP address (we live together). I know it’s supposed to be one account per household but I was wondering if he could work for one of the other online companies like leapforce? I like to do everything by the book, especially when it could jeopardize my income but I wasn’t sure if there were any rules against this. I was hoping someone here would know the answer. Thanks.
According to Leapforce policy you may have one account per IP address, while Lionbridge allows to have one account per household…Therefore I recommend you to arrange two different IP addresses (networks), one unique IP address for your PC and one IP address for your boyfriend PC. Make sure that each PC is connected only to a designated network. You may ask your internet provider to provide you with one more IP address or use SIM card internet for this purpose (SIM card intenet has dynamic IP address, it is not suatable for Lionbridge application process but ok for Leapforce).
Thanks to Tim now I am part of the company, without him I never would. I recommend their services for all seeking to work with Google.
I started kinda fast to do tasks and did 2:23:00 hours in the last 3 days, but 23 minutes of them are not payed. Now i fear that my Quality could be not good enough for leapforce, is it possible to still raise my Quality until the next month? And how does this work best?
Technically you cannot change your quality score for current month if you have already done your quality tasks.Typically tasks which are available for new raters are quality tasks up on which raters are accessed for their quality. Time spent for completing tasks has no affect on your quality. At the moment continue doing live and simulation tasks as normal and wait for your quality score which will be available in the end of this month…
DId you see anyone getting fired in their first month .Do new raters get warnings before they get fired??
Please are simulation tasks rated and can i be placed under review cause of it?
Based on my experience, only those new agents are fired who get very low quality score for thier first month of service, the rest of raters with substandard quality performance get restriction on access to tasks until next revision. This is not valid for Lionbridge, they seem to be less strict on new raters…
Please kindly advise if it is possible to get payment by paypal? i could not find an answer on that.
Leapforce and Lionbridge do not make payments via PayPal. You have to have bank account registered on your name in order to be eligible for this job.
Hello Tim , right now I’m on level 1 and sometimes I get to work 1 hour per day and sometimes don’t , when I’m on level2 am I gonna work 2 hours every day or just sometimes ?
Please read COMMON ISSUES OF NEW RATERS post, the last paragraph
I got a contract for Leapforce but I want to leave the apartment for a new one which means I will change IP.
Does it make any problem for me?
Once you are in the Project, you may change your IP address many times it will not affect your project status. Make sure that you do your project tasks in a private place as it stated in the contract.
You have been permanently blocked from acquiring tasks in the Yukon project due to quality issues with your submitted work.
Please visit the Projects page on the Leapforce website for other projects that may be available to you. We would like to remind you that you are obligated to maintain the confidentiality of the Yukon project and any information related to it. Please destroy or securely discard all instructional material related to this project that you might have downloaded or printed from EWOQ or the Leapforce at Home website.
In this case what can I do?
In case I have received this kind of email, what can I do?
“The Leapforce at Home quality review team has recently conducted a review of your completed Needs Met evaluation tasks. Your tasks were inspected for accuracy and compliance with Leapforce’s quality standards. Your Needs Met Quality Review Score is very important, please be sure read this entire message. Also, please be sure to review the personalized feedback for these tasks. This can be found on your Leapforce Project Yukon homepage under Needs Met Quality Review. Note: personalized feedback may not be available in all locales.
YOUR NEEDS MET QUALITY SCORE: Unacceptable
Your quality review is scored on a six point scale, ranging from Perfect, Excellent, Exceeds Expectations, Meets Expectations, Substandard Quality, to Unacceptable. Receiving a score of “No Score Available” typically indicates that you did not complete enough tasks to produce a review. “No Score Available” is treated as a neutral score.”
Dear ADVISORFIRST than Q for clarify leapforce Problems actually I passed all 3 exams of leapforce and after 3 days I filled forms and payment method too now i got New Evaluator Level 1(project 1) but i want to stop leapforce work completely up to 4 months due to my personal problems busy life
It may cause BLOCKED leapforce Account??? answer ASAP.
Dear ADVISORFIRST than Q for clarify leapforce Problems actually I passed all 3 exams of leapforce and after 3 days I filled forms and payment method too now i got New Evaluator Level 1(project 1) but i want to stop leapforce work completely up to 4 months due to my personal problems busy life
It may cause BLOCKED leapforce Account???
You should cosult with your agreement with regards to min. required number of tasks to be completed per month in oder to stay active in the sytem…If you do not meet the requirement regarding min. required number of tasks, your account will be deactivated. To become active again you will have to go through the qualification process one more time.
than Q for ur ever fast express reply
I’m very new to leapforce is it compulsory to Complete 1.Needs Met Simulator 0 of 193
2.Needs Met with SXS Simulator 0 of 90
3. Page Quality Simulator 0 of 102
how do I need to do the invoice, does it needs to have a certain format? Where do I have to submit it?when will i submit it before starting task or after finished task Thanks
You are not obliged to complete all/any simulation tasks, but I strongly recommend you to practice on these tasks befor going for live tasks. For more info please read my post “Common issue of new raters – Quality”.
I have selected for Project 1 (New Evaluator Level)
10 days back but still I’m reading Academy Next QUIZ then Simulation totally it takes 40 days to complete all.
what will happen if I will not start New Evaluator Level 1???
what is the due date of to start 1st New Evaluator Level 1
Plzz Reply ADVISORFIRST
If you feel that you are ready to proceed with real task go to http://www.raterhub.com to get live tasks. You are not obliged to complete all simulation tasks…Currently you have 1 hour per day access to live tasks as new evaluator level 1.
Where can I access the simulator to practice part 2 take Leapforce?
Leapforce does not provide candidates with pre-exam simulation tool.
HI Tim,
“…new agents should focus on doing simulation tasks and self-education. Time spent doing this will really pay off, and you wont be restricted for quality in the future.”
How many weeks do you suggest doing sim. tasks & self-education upon being a new hiree? Or, does that depend on when you started employment?
Thanks,
Susie
It depends on you, you may need a few days of training on simulation tasks to feel confident yourself in terms of proceeding with real tasks. if you get stable quality level when doing simulation tasks, it means that you can do live tasks with no risk of being put under quality review next month. Make sure that your quality level/expertise is good in relation to Side by Side tasks, because when you do quality review tasks, there are 14 side by side tasks and if you rate 5 tasks incorrectly it means that you might get substandard or unacceptable score ((5/14)*100%=35% of tasks are incorrect))
Hi! I’ve a question about ip address. I’m italian and I’ve a dynamic one because a static ip is expensive! This is a problem for leapforce? Thanks a lot
It might be very risky to have this type of IP address because it means that many people have the same shared IP address. This may lead to:
Multi-accounts conflicts (when people use the same IP address ):
Be informed that it is prohibited to have multiple accounts, without special arrangement. Leapforce and Lionbridge can find duplicate accounts very fast, and as a result, you will lose both accounts, or if you are at the stage of qualification (provided someone has the same IP in the Leapforce or Lionbridge project), most likely you will fail the exam, due to this reason.
IP/Network sharing
In some cases people may share their Internet network, while working as search engine evaluator make sure that you have your personal unique IP address and no one uses the same IP to go online for rating project.
Hi, I’ve a question about leapforce. They don’t reply..so I hope you can help me! I’ve an ISP named Linkem that allows more users to connect to the same ip address..ip is not public! So it’s possibile that I connect to my ip from my house and another user, unknown to me, connect itself to the same address from another italian region! IS this a problem? I’ve to change ISP for a public ip? thx a lot
1. Can i apply both lionbridge and leapforce?
2. You mention IP restriction is that means that if I work on diffrent networks or away from home I can’t do my rate jobs?
Hi,
1. Yes you can apply for both Leapforce and Lionbridge, but once you are invited for qualification exam, you have to choose only one vendor, otherwise it will lead to gmail/ip address conflict and termination of qualification process or your contract.
2.You should keep the same IP address only during the qualification process, once you are in you may change your IP address many times.
Ok thank you for your answer i have abandon the leapforce one then.
Can I email lionbridge to notify me more task to me if i can where i can email to?
Is it in the contract that you cannot work for both companies at once? I applied to both not knowing much about the background of each company, just knowing it was similar work. I read the contracts as best I could and I was accepted into both programs and passed both exams and sent in all my bank details. I started working a week with one and then started the other a week later because I did here in a blog that once you apply you can never apply again. So I didn’t want to lose out in case the first one didn’t renew the contract. Well a few days ago, I was terminated from both and I assumed it was because Of my productivity. Then I search and find your blog which is very helpful by the way. 🙂 I’m really bummed out and worried because I’m a stay at home mom who’s broke and this job was perfect and I didn’t expect this. Is here any way they would reconsider me if I reapply to only one of them this time or even reinstate me?
Yes, you cant work at both companies at the same time under one name/gmail account/IP address.
In your situation I would advise that you apply for search engine evaluator position on behalf of your husband or mother or whoever you trust. Before proceeding with registration, make sure that you use a new gmail account, when filling out the application and answering the application questions, indicate that you have never applied/worked for search engine evaluator position before. A new IP address is also required. You may use VPN to change your IP address. Once you have started the application and qualification process, I recommend you keep the same IP address during the process.
Thanks Tim! Hopefully I’ll pass it again. Lol. Those were tough tests. I had a lot of “practice” while working for them, so we’ll see. 🙂
what if i press the wrong button while in exam page on raterhub?
here is my case
im accidentally enter the exam page without know that is the EXAM PAGE while testing the raterhub navigation.. i want to back or i dont want to start my exam yet because I have not had enough study the guidlines.. then i press the “cancel” button, and then i sign out from raterhub.. fear that im doing it wrong i singed back again and there is button “unfinished task” then i press that again.. and notice the question of the task is change from last time i got there (is this another page / did i just miss or failed the exam page 1?)
im not answer the “true false” question yet.. im just pressing cancel – sign out – then sing in again then while im searching for the answer of my problem i got countdown time “this page will terminated with the timer.. then i had to choose expired page to back to home”
my question is : was i just failed my exam accidentally?? did i had to start all over again from the beginning to retake the exam? i heard that need 1 week after LF sending new retake exam…
i sending email to the company and they only answer “we are cannot give you any feedback during your exam.. best of luck”
still confusing until now
Hi,
That is actually is a very good question. In part 1 you may leave incomplete test form/web page and come back to it at any time, it will not expire and will not affect overall outcome, but be careful with part 2 and 3, tasks in those parts will expire in 60 min automatically. Expired task is counted as “failed” task.
On exam re-take You will have to go through all parts of the exam again, practical tasks in part 2 (Page Quality) and part 3 (Send to Device) will be different from those you had on your first exam, although there may be a few tasks that come from previous exam.
Hi, I am new to leapforce. I’ve got a question about the leapforce extension. When it says ‘on’ is it already counting my time? Because even if its already on, I can click on it and it still says ‘on’ but its shaded grey. (So to say like a pressed button).
Which of these two is the way to track time? Is there a video or a section in the FAQ about this?
Thx for your good work 😊
Maybe my question was not so easy to understand: Do I additionally have to click on the extension to log my time when the extension is already on?
Hi,
You have to log on to the Leapforce extension each time you work in the system. This extension records time on Leapforce server in order to compare time you invoice them for your service with actual time spent in the sytem.
Thus you have to count your time spent for doing tasks by yourself. Here is an app whaich might be helpful to track time.
The first one is called RaterAide which is a task tracker and timer which keeps track of all tasks and shows the time you are spending on each task. It keeps an accurate record of how much time you worked so you can submit accurate time on your invoice. Your data can be stored on Dropbox meaning that everything can be synced across all your mobile devices.
Link to app website: http://www.rateraide.com
In the beginning you may spend more time than the average estimated time that Leapforce allocates to the task, but make sure that in the invoice you put average estimated time that they give you. If you spend less time than average estimated time per task or set of tasks, be informed that your invoice will be returned for correction, Leapforce will ask you to put actual time spent, that is why there is no sense to complete tasks faster than average estimated time. Take your time, do everything correctly and watch your time.
Was my answer helpful? If yes, buy me a coffee!
Hi I accedently didn’t use rater extension when doing task its 2 hours long because I do it in laptop, usually in desktop PC and I forgot to install it 🙁
Is that 2 hours long can’t be reported? 🙁
And I get email that say my quality not very good and has to do learning portal what should i do now?
Hi Nitraion,
You should forget about 2 hours session because you cannot invoice it if your extansion was off during working process.
As to restriction due to quality of your service, now you should focus on doing simulation tasks and self-education. Time spent doing this will really pay off, and you wont be restricted for quality in the future.
The for your respond my only problem it seems language barrier as English is not my main language
Also I start work at middle of month so is it okay that I didn’t meet 10 hours requirement?
hello,
I think as a starter you wont be penalized for not reaching 10 hours requirement.
if I am not mistaken, you mentioned before that doing simulation tasks will ‘pay off’, does ‘pay off’ you mean we get paid by LeapForce as well for doing simulation task ?
Simulation tasks are not paid, it is stated in Leapforce policy.
Hi,
I had an issue with my url on my phone and it took me some time to fix. I was on my first question on part three of the exam and it timed out before I could complete all of the assessment. Do you know if that counts against your score, or if you are just issued another question?
Thanks!
Hi Georgia,
Unfortunately yes, the expired task will not be counted as complted task and most likely you will not get sufficient passing score.Do not leave incomplete tasks more than for 1 hour, otherwise they will expire and you will fail the exam automatically. If you need to take a break,complete tasks and press “Submit and Stop rating”.
Hi, thank you very much for your posts, they are very helpful !
I signed my contract yesterday and today I was informed via email that my account was active.
Since i joigned the program later (July 26\27), how will it be possible for me to complete the required tasks at the end of this month (literally in 3 days) ? Will i be penalized? Will my account be deactivated? I was planning on doing self-education and simulation tasks before taking live tasks..
Thank you in advance for your response.
Hi Tim, thank you very much for your posts, they are very helpful!
I signed my contract yesterday.and today iI was informed that my account was active.
Since I joigned the program later (july 26\27), how will I be able to complete the required number of tasks at thend of this month (literally in 3 days)? Will I be penalized? Will my account be deactivated?
I was planning on doing self-education and simulation tasks before taking live tasks.
Thank you in advance for your response.
Hi Soralya,
I do not think that as a new rater you will be penalized for non completion of required number of tasks, take your time and upgrade your rating skills by doing simulation tasks…
Hello Tim! Thanks for giving so many information about LeapForce
i am new rater so I want to ask you some questions
I want to know when (date) usually you submit your invoices ? in the policy it’s stated that “Invoices may be submitted any time after the invoice period has ended.”. Does it mean that for Invoice Billing Period July (07/01 – 07/31) I can click ‘Submit Invoice For Approval’ on 08/03 ?
And when they usually transfer the money to us ?
Hello,
I am wondering if it is normal to not hear back from Leapforce for 3 days after I completed part 3. The first time I took the test, i did not pass part 3 and I was notified of that within about 6 hours. I completed part 3 this time on Thursday evening, and the test was set to expire on that friday at 12am. I still have not had any correspondence from them. Anyone else have this experience?
Thanks!
Hi
I had got a termination notice on mail from Leapforce after six months of working with them and its as below:
Leapforce, Inc. finds it necessary to inform you that we are hereby terminating the Independent Contractor Agreement between Leapforce, Inc. and yourself due to the material breach of your obligations under the Agreement.
I mailed them back but no reply on why ths termination
Can I reapply for the same job, if so after what period I can do so?
Thanks
Yes , it is possible. Please read ‘How to reapply’ section on my blog.
I couldn’t find the HOW To REAPPLY section. Please help.
Hello Tim ! I want to ask something regarding payment.
For August 2016 invoice, I already submit it on September 2nd 2016, and the status is already approved, but until today (September 17th 2016) I still haven’t got my payment in my bank account. Do you ever face same problem like me ?
Hi,
According to Leapforce payment policy, the payment is made within 30 days once your invoice is approved. Normally they pay on 22nd-28th.
just received an email from lionbridge saying I have the same IP address with other person so I was unable to take the exam. I didn’t know that sim card internet had dynamic IP address. Will I ever get the chance to work for similar companies with dynamic IP address??
Yes, Leapforce does not care much if your IP is dynamic.
Hello Tim ! I worked for Leapforce science 2014 with different accounts , I am from Egypt, recently I have been permanently blocked for my last account, I want to reapply again, I know how but at many times I got no answer back, I want to know how I insure that I will be accepted to move to qualification process.
Try to arrange new IP address, update your CV, create new gmail and apply one more time, if possible on behalf of a person you trust, because it might be that your name is blacklisted on Lionbridge/Leapforce database.
Hello Tim ! I worked for Leapforce science 2014 with different accounts , I am from Egypt, recently I have been permanently blocked for my last account, I want to reapply again, I know how but at many times I got no answer back, I want to know how I insure that I will be accepted to move to qualification process.
Havent heard back for months. Im aware on how to create accounts but nothing is getting through to the contracts in order to get to the exams. Has the US hiring been on hold in most states?
As far as I know Lionbridge has been recently hiring people in the USA. You may apply here:
http://www.thesmartcrowd.com/about/workers/job-opportunities/
As to Leapforce they do not hire many people at the moment, only a few people are invited for taking the exam in the USA.Most likely your application is on a waiting list.
Tim I have a relative who has been working with LB for a while. I just got invited to take the test, will having a close relative already working with LB be a conflict of interest if I was to pass the test? I don’t want to get him in trouble.(Different households)
Hi,
If you use your own landline Internet and pc for this project then it won’t create any ip related conflict or problems.
While working as a search engine evaluator, make sure that you have your personal unique IP address and no one uses the same IP to go online and work on for these companies.
If you have two or more people in your household, it is advised to get two unique IP addresses, and you can do this for an extra charge with most internet service prooviders.
Hi Tim
Thank you for the helpful post. Regarding the ‘Quality Review’ done by Lionbrige, are you aware of any other algorithms they use to choose the ones to be placed ‘under review’.? I noticed that they are quite responsive with SXS comments as you mentioned.
hi Tom,
As you may know in the end /beginning of each month, a certain number of quality review tasks are uploaded into the system. These tasks are quality performance tasks up on which your quality is measured each month.Tasks have to be done by all raters and they can be identified by the fact that they are available all the time for completion.
In most cases those quality review tasks are Side by Side tasks. Normally there are 10-15 Side by Side tasks and if you rate 3-5 tasks incorrectly it means that you might get substandard or unacceptable score ((5/14)*100%=35% of tasks are incorrect), quality score below 80% may lead to restriction or quality audit or in case of getting unacceptable score it may lead to removal from the program.
PQ review tasks are usually uploaded once per 3-4 months..
Hello Tim ! Does Leapforce accept payoneer as a bank account or any virtual US bank.
Hi Sam,
Honestly I do not know, but from technical point of view, Payoneer bank account is the same as any normal bank account. You better write to LP and ask them directly.
Hi Sam,
Did you have any chance to find out if Leapforce accepts Payoneer as a method of payment?
Hi Tim. I am wondering, do you know if Leapforce or Lionbridge require you to have an actual smartphone, or do they allow someone to use a free android simulator?
Thank you.
Hi,
Now Leapforce and Lionbridge require all applicants to verify real smartphones during application process, if you use Android emulator their system will detect this fact…
Hi Tim,
Thank you for this great website and all the effort you put into this.
I’m a new Lionbridge Rater and looking for some advice to improve my productivity. When working on a task, I am always far behind the estimated time (i.e. I need more than 20 min for a 9 min task). I know that I will get faster with more practice, but I can’t imagine how it could be possible to check the reputation for 10 pages within 9 minutes. And for Side by Side tasks there is so much more to do in this small time frame.
I already rely more and more on my feeling, do not really check or assure things, especially regarding PQ. And this doesn’t feel right. Lionbridge says that quality is more important than time, but this doesn’t make sense to me, if I get just paid for the AET.
I’ve done some web research, but couldn’t really find other raters speaking about time issues. So maybe my procedure isn’t the best? Do you have any advice for me?
Hi Steph,
Many new raters need more time than AET allocated to a specific task and it is ok. When you get more experience you will do tasks within ATE or even less time.
You should not sacrifice quality for time. In the beginning you may spend more time than the average estimated time that Lionbridge allocates to the task, but make sure that in the invoice you put average estimated time that they give you.
As to PQ tasks: while giving E-T-A rating you should evaluate MC under these 3 criteria (E-T-A). In most cases you may do it fast at a first glance approach, but be sure to provide good evaluation for E-T-A when you have YMYL query.
Hi Tim,
Thank you for your reply. So you think (or know) that Lionbridge won’t accept the real time in the invoice? Lionbridge says “it is expected for you to take some time to be fully up-to-speed”. But it’s not okay to bring this time to account?
Last week I worked about 25h (incl. doing tasks, practicing, reading instructions and several guidelines – English isn’t my native language, so this needs time), but I couldn’t accomplish the expected 10h allowable time. I suppose it’s fine to don’t reach the goal in the first two weeks, especially with the holidays around, so I don’t worry about this. But it rankles me to put so much time into this and not being paid for at least the hours of working on tasks.
And regarding PQ tasks, or let’s say Side by Side tasks with Needs Met and E-A-T rating included: With some experience, is it really possible to rate Needs Met and E-A-T for about ten results (YMYL or not), to assign the SxS rating and to provide a good comment in just 9 minutes without sacrificing quality? Hope this doesn’t sound harsh, I’m just sooo far from AET that I need some confidence that this work pays off in some weeks.
Hello Tim, I want to ask. Few days ago, my laptop usually used for work at leapforce got broken. Can i use another laptop to work at leapforce (but still use same wifi connection) ?
Hi,
Sure, you can use a new laptop and even change your IP address, still it should not affect your status in the project.
Hello,
I’ve just received a message from LB telling me I couldn’t work for them because there was someone else registered on their system using the same IP adress……………… how is that even possible?!
Nobody in my house work for LB. I don’t share my Net with anyone, only in my house it’s being used by me and my parents.
I would appreciate if someone could help me to solve this issue, or else I won’t be able to proceed on the program.
Thank you
Hello,
Before assigning exam, Lionbridge and Leapforce check your gmail IP history for IP address match with another raters.There are two possible scenarios which may lead to IP address conflict:
a. you have dynapic IP address and another rater also has dynamic IP address, both are using service of the same Internet provider. Sometimes Internet provides may assign the same IP address to its customers. In this case Lionbridge will see the case as one rater has two accounts due to IP address conflict.
b. You connected to someone network which is already in use for rating project.
Solution to the issue: make sure that you use dedicated and static IP address.
Is it ok to do tasks quickly and build up extra time. Say I submit tasks 2 min early and build up an excess of 10 minutes. So on my last task I let the timer run for an extra 10 minutes?
I have been doing this but sometimes get my invoices sent back and there will be one day they say I have to take time off of. I was wondering if this could be the problem.
Thanks!
Hello,
In the beginning you may spend more time than the average estimated time that Leapforce allocates to the task, but make sure that in the invoice you put average estimated time that they give you. If you spend less time than average estimated time per task or set of tasks, be informed that your invoice will be returned for correction, Leapforce will ask you to put actual time spent, that is why there is no sense to complete tasks faster than average estimated time. Take your time, do everything correctly and watch your time. You should invoice only AET!!!
Tim. And my first time in a qualifying process for Appen. Falcon Ads Project. I am anxious and afraid of making mistakes, so I decided to study all the Ratings Explanations before starting the qualification. That’s why I found your blog, it has an excellent reputation. My question is: my computer and my phone have more than 3 years of use, I can not buy new devices before the exam. Can I be harmed by this?
Hello, Marcelo.
Do not buy new equipment specifically for this project. Any PC even with Windows XP OS will be OK to participate in this project. Your phone also should be ok for this project.
i am restricted for one day i don’t know why. one thing i did was to click submit and stop rating twice regularly, please explain is this the reason.
Probably your restriction has to do with quality of your service, please wait for email from your vendor.
When we begin rating, would be like the exam? For instance, once we click on the task it will last up to hour?
Hello,
Please read this article:
https://passleapforceexam.com/2016/01/10/common-mistakesof-new-raters/
I recently applied for a position at RaterLabs. However, I received an email from them asking for my email password. I do not feel comfortable giving this information. Is this a legitimate request and why do they need that information?
Hi,
Are you sure that they asked you to provide them with your Gmail password? I have never heard about this before, you either confused something or it is scam. Could you share with us the exact wording of the request?
I am from india. I have qualified for Nile project but did not receive any email for becoming frt. When would i get the email ensuring that i have been added in frt?
Hello,
It depends on many factors. The procedure is the following:
Once you are invited for the project it means that your application has been reviewed and approved for the project and you are placed in a project queue.
It might take up to a few months before moving to the next stage (production), it has to do with fact that the project has limited capacity and vendor and customer need time to fire unsuccessful raters and replace them with new raters.
I am working for Lionbridge. I am put under review for quality for a week. Will I be paid for the work which I have completed till date?
Quality audit is a normal process, many of new raters are going thruogh it. If Lionbridge or Leapforce quality team find out any issue in your service, they will assign you e-learning educational course, once you complete this course, you will be allowed to continue working in the project. All work done previously will be paid as per your contract terms and conditions.
Hi Tim
This might be a silly question, but I got accepted and sent all my paperwork and they said Im all set to login to start work. But what is the address to login to work? Ive looked everywhere they never gave it to me in an email
Thanks
Hello,
You need to logon your Raterlabs/Leapforce profile in order to get access to your personal page and all links/resources which you need in order to proceed with work.The link is available on Leapforce /Raterlabs website.
Hey Tim, quite a job you’ve done here leaving no comment unanswered, thanks so much for your work. So my question is, that I just signed the independent contractor’s agreement, however it is not very clear to me how I’m going to be compensated since at no point I was asked for any relevant information. Is this something filled at a later stage?
Hi Tim,
How to record time for mobile task in leap force. Rater aide pro is paid. Is there any free app to record it.
Hi Tim, I’m working for Lionbridge. My score for last October (NM=91,9% and SxS=100%) are meet the expectation from Lionbridge standard (85%), but suddenly I received email that they indentified quality issues with some of the tasks I have recently rated, so they conducting general review and put my account under review for 7-10 days. How could that happen when my score is fulfilled their minimum standard?
Quality of raters is measured not only by means of quality review tasks (monthly feedbacks). Once per a several months vendors may conduct global quality audit, even raters with high scores might be placed under quality review process in order to examine their work in depth.
How would you rate a page where nothing is found? I was taking part two of the exam and has 2-3 tasks that had nothing on the landing page but the website itself was fine. Just confused on how I should rate it for quality.
Fails to met, Lowest, Did not Load
hi Tim , can I receive payment on my father bank account ? , I am applying for lionbridge .
Hello,
No you cannot. Bank account holder name must be identical to a independent contractor name, otherwise you will not be able to receive any payment and as a result your contract will be terminated.
thank you
Am I allowed to start working without providing bank account ?
What is leapforce extension and Where can i find it to download it ? Should i download on my pc before doing tasks and I want to do simulation tasks but i cant find the page Where i can do this. I hope you can help me with this
Thank you very much.
Hello,
Go to your personal Leapforce page, there you will find the page called Leapforce extension, read the info on the page carefully and follow the instructions.
there is website reputation research mentioned so often, but i found that on the page quality rating exam, it was difficult to locate any reputation for at least 3 of the examples. I know wiki, bbb, etc but even then, it was difficult. Any tips?
In my view the profound ETA research (including reputation) is important for YMYL pages, in another cases if you cannot find reputation, you just select ‘no reputation found’.
Hi Tim,
Are there simulation tasks for shasta project. And for rating is there difference between rating with fresh viewport age and stale viewport age? Or should one rate the same way both? Thanks
Happy to report that I passed Lionbridge exam the second time. =)
I have been working for Lionbridge for almost four months. But how do you know that you are under quality review?
I have always met the quality scores for each months that I have worked for. But Today I received two emails from the Senior Quality Controller asking me to explain why I rate what I rated on specific tasks that I had rated. I have not yet received any emails informing me that my account has been placed under quality review.
Am I under quality review? Please help me. I am freaking out.
In many cases raters might be asked to explain some of their ratings, it is normal and it does not necessary means that they are under quality review. However, very often rater’s account might be flagged for quality by the system automatically, so it takes time for Lionbridge or leapforce to get to know about it. In this situation, if you have an assumption that your account is placed under review you may write email to support and clarify the status of your account.
Hi Tim,
I work for LB and its been 6 months I am with the project earlier until l last week I never had restriction on time i can tend to work as many hours possible but suddenly from last week i am allowed to work only for 3 hrs/day will it resume to normal could you please explain? is this because I am not doing simulators frequently? Kindly assist me on the same.
Sometimes some raters do not get their restricted status changed to unrestricted with getting a meets expectations or above quality score or some raters get restricted without a proper reason. This happens because they were restricted for Side by Side or PQ tasks quality issues and feedback was released for needs met tasks. In order to lift up all restrictions a rater will have to wait for the next quality review cycle for type of tasks a rater was initially restricted for.
And finally, at the end of month, if you get meets expectations or an above quality score your account will be unrestricted again.
Hi Tim,
I appilied for leapforce Yukon project and its a option to reschedule it :
1. how may times we can reschedule it and
2. will it affect your second chance for exam(if failed first time).
pls advice.
Thanks
You may reschedule your exam a few times, it will not affect your probability of passing this exam.
Hello tim
I received an email from quality team with 3 errors listed in an email
They ask me to provide explanation to these errors
I am convinced that they are errors and i rated it wrongly
Can you please tell me how to answer to such email
Thanks
Hello,
You should explain why you made rating mistakes and what you will undertake in order to prevent making the same mistakes in the future.
what I read here about this information is very interesting. I wanted to know if: a person has given the yukon exam 3 times and has failed. You can be called back or reapply to redo the yukon exam after some time or it is completely excluded?
In some cases a few raters are allowed to take the exam up to 4 times, maybe you might be one of them ;)!
Really? I had never heard of having up to 4 chances to take this exam, but it is possible that they recall even after 3 months?
Hi,
I am from Pakistan and passed the rating exam of Lionbridge. I kept logged on for hours many times but found tasks only one time. Those tasks were also for maximum of 30 minutes only. Are there some strategies for getting tasks? I am able to get only 30 minutes tasks from January 02, 2018 to February 27, 2018. Please guide me. If we don’t get enough tasks for at least 10 hours per week then there is no logic to continue on the program. Please guide me.
Can I complete the Yukon project work from different places with my laptop? Or is this just allowed from the original location (home) where I applied for the job?
Hello,
it is highly recommend that the qualification process is completed from one place/IP address. Once you are in the Project, you may change your IP address many times, it will not affect your project status. Make sure that you do your project tasks in a private place as it stated in the contract.
Can I be locked for productivity for not working enough hours during a working period? I just started with less than a week left on the working period and could not meet the minimum 10 hours.
Hello, I do not thinks so, only if you have multiple cases of not meeting productivity requirements.
While taking LB exam I faced some internet connection problem. So I switched the connection. Will it anyway affect the qualification.
Hello,
No it will not affect the process.
This blog tremendously helped me pass the exam. Thank you.Does Raterlabs or Lionbridge fire raters for unsatisfactory work quality? Do they give you a warning in advance if they do?
Hello,
Thank you for your feedback. I recommend you to read this article: passleapforceexam.com/2016/11/20/how-to-stay-with-leapforce-for-a-long-time-and-not-get-fired/
Hello,
During your participation in the project your service will be evaluated on quality by means of quality review tasks.In the beginning of each month, a certain number of tasks are uploaded into the system. These tasks are quality performance tasks up on which your quality is measured each month, the end of the month you will get your quality score feedback.
If your ratings often falls out of general range of ratings, most likely your account will be flagged by the system and your work will be checked for quality manually.
Read more about this topic here:
https://passleapforceexam.com/2016/11/20/how-to-stay-with-leapforce-for-a-long-time-and-not-get-fired/
This is my third month and I’ve not had any feedback from Lionbridge. When I go into feedback it just says Error. There is nothing there. What should I do? I would like to have a score to track my progress because sometimes the work SxS is so subjective it’s hard to know if I’m doing them to their standard.
Hi, I am new at the Yukon project. Do you know where I can check the average time for each task once I already finished them? They returned me an e-mail saying that I was spending too much time on my tasks but for this month I know I have been taking my time in some tasks. Do you know where I can find this information so I can fix in the current invoice? Thanks!
I’m receiving a connection error whenever I try to use the tools on LB. It was working at first until I updated the Facebook app itself. Is this a sign of termination?
Maybe, I recommend you to write to agent support team and clarify the issue.
Hi Tim,
I have a question, the side by side task, that we have to evaluate several results, both in quality and Needs Mets, we have 9 minutes to evaluate each result or is it 9 minutes to evaluate all the results of the page?
Hello, this AET is allocated for the whole task to complete.
Hi Tim,
I have 2 question to ask bout working for Lionbridge :
1/How can i know exactly time zone in live rating task with purpose to fill in my working time in timesheet ? ( My location is Vietnam )
2/Does Lionbridge accept different IP when working live rating task ? ( I’m new rater and sometimes i want to work in my company).
Thanks you !
Hello,
1. In order to select you time zone go to Supplier portal->Own data->Time zone->select what is applicable to you.
2. Once you are in the project, you may change your IP address many times, it will not affect your project status. Make sure that you do your project tasks in a private place as it stated in the contract.
Hi,
I have a problem with invoice at Leapforce, I thought that their system records working time automatically so I did not keep records of my time, what should I do this situation?
In your situation I recommend you to fill out the invoice with approximate hours you can remember, and make note under your invoice that all data was lost and ask Leapforce to send you the actual recorded by their system so you can enter correct time when they ask you to edit invoice.
Hi Tim,
i received this from Appen finiancial team today.
Invoice Returned for Missing or Incorrect Data
Your invoice has been rejected for missing or incorrect data. Please make the necessary corrections or provide specific details on the reason for each discrepancy.
Time Discrepancy: For the following line item(s) there is a discrepancy between the hours you have submitted and the activity and work recorded on our servers.
11/27/2018
Reported: 3 hours, 40 mins
Unaccounted Variance: -46 mins
what does this mean? are they saying that according to the information they have on their server i have worked 3 hrs 40 min+ 46 min but i did not mention that +46min in invoice?
Hello,
It means that you have to deduct 46 minutes from your invoice, in the future make sure you enter only AET into your invoice.
Hello,
I received the following email:
Tim, hour serious is this warning and what should I do in this situation?
This email is a reminder that raters are allowed to bill for the AET of a task OR the actual time spent working, whichever is LESS of the two amounts. It has been discovered that you are working some tasks much faster than the AET followed by holding on to a task for much longer than the AET and billing for the full amount on your invoice, which is a violation of official policy and will not be tolerated.
For example: You work 5 tasks, each with an AET of 5 minutes. The first 4 tasks you complete in 1 minute each, and the 5th task you hold on to for 30 minutes.
This is an official warning. If this pattern continues, your invoice will be rejected and you will be removed from the rating program. Please be sure that all future invoices are in compliance with policy.
Kind Regards,
Your support team
Hi Tim,
I am very new to Yukon and this post is very helpful,
Tim , Do i really need to keep track of time for the invoice or i can just say for if i do 5 task of 3mins each i can just mention 15mins straight. because even if i exceed the time limit i will be paid for the same 15mins. should i just keep track of my task counts. and i will make sure i spend atleast 3mins on each with my research.?
Thanks,
and I just been hired , Can i practice simulator task for a week and then start working.
hi there, I’ve been working on Yukon project since november, so basically I’m into my 3rd months.
however, today I received this email by appen:
Non Compliance Notice: Your completed productivity rate does not meet our policy for the billing period.
Your productivity rate(s) for this invoice are:
Project Yukon: 55 % of target.
This means your total invoiced time exceeds the total amount of time you were allocated for all of the tasks you completed during the billing cycle for the projects listed above. Per written policy, all Search Engine Evaluator’s are expected to maintain a task completion rate consistent with what is listed on our Policy page. You are advised that the work being performed, as detailed by this invoice, may not conform to the contract requirements and may result in a temporary hold placed on your account and/or rejection.
Please review your invoice very carefully for accuracy, and correct any mistakes prior to final submission. If you do not find any mistakes on your invoice, you may choose to re-submit your invoice as is, and by doing so you acknowledge receipt of this notice.
In the event you have any questions or feel this notice is an error, please feel free to contact us via email. We look forward to working with you towards a resolution of this issue.
I don’t know what to do, I told them that I might have finished some tasks faster and some a bit slower for quality purposes.
i’m so worried 🙁
Invoice Returned for Missing or Incorrect Data
Your invoice has been rejected for missing or incorrect data. Please make the necessary corrections or provide specific details on the reason for each discrepancy.
Time Discrepancy or low productivity. For the following line item(s) there is a discrepancy between the hours you have submitted and the activity and work recorded on our servers.
Reported: x hours, xx mins
Unaccounted Variance: -xx mins
What raters should do in this situation?
Raters have to deduct xx unaccounted variance minutes from the invoice, in the future make sure only AET is entered into invoice and the Leapforce exstension has to be always to be on while active rating.
Working some tasks much faster than the AET followed by holding on to a task for much longer than the AET and billing for the full amount on your invoice
This email is a reminder that raters are allowed to bill for the AET of a task OR the actual time spent working, whichever is LESS of the two amounts. It has been discovered that you are working some tasks much faster than the AET followed by holding on to a task for much longer than the AET and billing for the full amount on your invoice, which is a violation of official policy and will not be tolerated.
For example: You work 5 tasks, each with an AET of 5 minutes. The first 4 tasks you complete in 1 minute each, and the 5th task you hold on to for 30 minutes.
Thanks for replying back, so it actually means that I’ve worked faster than the AET! is it correct
I can’t put on question marks I don’t know why sorry.
BTW, what should I do with that invoice cuz I don’t remember where to correct tbh
I sent them an email telling them that I might have worked faster on e some tasks while I had to put on more time on others
I recommend you to wait for the reply in most cases they send recorded worked hours so you will be able to update your invoice as per Leapforce records.
Tnx for your reply I’ve been informed that :
Based on the number of tasks you completed in December the total AET time is 15 hours and 14 minutes for the YUKON project.
Well it means that you may invoice this time, but for the future make sure you record your time and fill out invoices according to the policy of Leapforce.
Hello Tim! Thank you for very useful site.
I have been terminated from Lionbridge (ads project). I want to apply to Appen. Do I have to change my ip address, or it is enough to get a new google account? Thank you in advance.
Hello, there is no need to change IP address, you may apply for any position at Appen.
Hello Tim,
I wanted to ask you if there is any sort of career advancements for being a rater at LB? I have encountered a few threads about a senior rater position at LB and LF but I am not sure how to become one. Or are we stuck in the contracted fixed pay rate forever?
Also, how long can I expect to work as a rater at LB?
Thanks in advance.
A fellow rater.
Hello, yes I have some friends of mine who were promoted and became advanced raters, their payment rate was increased and new responsibilities were added such as preparation of quality review tasks and managing communication process with normal raters. I do not know exactly what is the criteria for earning promotion, but one condition is a must which is outstanding quality of service.
I just passed the exam and am currently in the process of filling out the paperwork. Am I still supposed to fill this out under the same IP address I took the exam? Also, I did not take the exam in my home and still passed, is that a problem? I switch between two homes so I would be working at my boyfriends house as well.
Once you are accepted in the project, you may change your IP address many times, it will not affect your project status. Make sure that you do your project tasks in a private place as it stated in the contract.
Hi I’m with Appen.
If I spend less time (e.g., 3 min.) than average estimated time (9 min.),
can I still put average estimated time in the invoice and will I get paid for 9 min.?
Or will they find the actual time spent and will I get paid only for 3 min.?
If you spend less time than average estimated time per task or set of tasks, be informed that your invoice will be returned for correction, Leapforce/Appen/Lionbridge will ask you to put actual time spent, that is why there is no sense to complete tasks faster than average estimated time. Take your time, do everything correctly and watch your time.
Hello I have a question if Lionbridge gave me the invoice for the first month and I decide to quit next month , will I get paid for the invoice for the first month.
I work outside the US so there are fewer tasks and I do not get the monthly rating score than I see others mention here. Because there is no way of knowing how I am doing I find it very anxious to work for them because I do not know how I am doing. I did 40 hours in February and not they have put my account under review. The third time in 12 months. The last 2 times they just responded with an example of my error and said not to do again. Still, I find it hard to know if I am meeting their standards or if I could be fired at any time. I would love to have a weekly review or something to let me know if I am on the right track.
Typically tasks which are available for new raters are quality tasks on which raters are accessed for their quality. Instead, new agents should focus on doing simulation tasks and self-education. Time spent doing this will really pay off, and you wont be restricted for quality in the future. Also, by doing a certain number of simulation tasks correctly you will upgrade your status in the system, and will be allowed to work more hours.
During your participation in the project your service will be evaluated for its quality by means of quality review tasks. In the beginning of every month, a certain number of tasks are uploaded into the system. Normally there are 10-12 tasks of Needs Met or Side by Side, and once in 3 months PQ tasks to be released as quality review tasks. These tasks are quality review tasks up on which your quality is measured every month, in the end of the month you will get your quality score feedback.
If your ratings often stand out of general range of ratings provided by other raters in the project, most likely your account will be flagged by the system automatically and your work will be checked manuallyfor quality .
I live in the countryside and my only way to connect to internet is via my phone. So I hotspot my phone and share my internet connection between my phone and my laptop. I do not have a desktop. Is this ok to work for Appen?
Also, I have two mobile phones line with internet and I hotspot both (password protected) so I sometimes use one connection and other times the other. I usually do not pay notice which one I am using. Is this a problem for Appen? I am pretty sure I was using one when I registered for the job and I have switched to the other, and back and forth, when I accessed the Appen platform and also when I took the exam.
I am not used to be mindful about that, but do I have to start being when on Appen?
I have a question and I didn’t know which page to ask. I’m on one project w/ raterlabs and another project popped up on the projects page saying I qualified and to apply. It’s more hours a week. If I apply will I lose my current project? Will I be able to do both? Thank you!
i just got into the lionbridge rating project as a rater from Nigeria. since i joined the rating program i have not had any task on raterhub for the past one month, except for a 10 mins task which was my first task. i wrote to them four days later and i was told there was no task available in my local and i should keep checking that task can be available at any time, but its been over a month now, still the same story. Does this normally occur, or is there something i need to do to pop up task, what do i do ?
Hi, I work in Vietnam Locale and got similar case for few months until now. Have you get more tasks or the case still remains till now?
hello everybody!
Need to be a google rater but my problem in my contry didn’t get any contract if someone interest to cooperate with me I am ready.Please call me on +261346199802
thanks
Mrs Moana
I had already worked in two jobs simultaneously and it was ok.
Hi Tim,
Is it true that lionbridge beginners get limited tasks to do in the first month of working… even after completing the Quiz given upon entry?
I say this because in these first two days of working… I have had access to around 2 hours of tasks per day but was expecting more. There seems to a limit right around the 2 hour mark and then I am automatically given the “No tasks available message”.
Is this normal and did this happen in your own experience?
Thanks, Josh
In general, Appen and Lionbridge guarantee at least 2 hours of work per day but task availability may depend on project locale.
There might be some days when tasks are available for more than 4 hours. Some locales, like the US project provides raters with 24 hrs/7 days tasks availability.
For the rest market task availability may be limited. You should understand that the system of task distribution is based on a ‘first come first served’ basis and you need to be ready to catch your portion of tasks when they are uploaded into the system. In order to identify time slots when task availability is the highest please look at task completion graph, usually tasks are uploaded every day into the system at the same time slots.
Lionbridge does not provide raters with a task availability instrument, so raters have to identify time slots when tasks are uploaded into the system by themselves.
Appen also has a system that restricts access to tasks for new raters, and those who are undergoing their quality review. To lift this restriction, you have to complete a certain number of simulation tasks or wait till the next quality review, if your quality score is good, the restriction will be lifted automatically.
Official clarification from Lionbridge regarding your question: As per your welcome to the program email please note the following:
As a new Rater on the program you will initially have access to a variety of task types. This is important as it will help you become more familiar with the core concepts of rating and help build up your overall experience and knowledge of the program. The volume of these tasks will initially be low as you continue to build experience on the program. Once we feel that you have a good overall understanding of the program and of the various task types you will see a switch in the tasks that you receive. From this time onwards, you will be required to focus on evaluating more video type tasks from an internet safety perspective and you should also see an increase in the number of tasks available to you.
Following from this there may be times when you have no access to tasks. Please follow the onscreen instructions. Please check back at the date and time specified for available tasks.
Please note that this process is no connected to your quality score.
We would encourage you to continue to login regularly and complete the tasks available to you. Tasks availability will improve as you complete tasks and the program progresses.
We will contact you directly to advise when this transition process has been completed.
Hi Tim,
I got the situation that taks is very limited for few months till now, even though I check the raterhub very regularly. As you mentioned, Lionbridge guarantees at least 2 hours per day but in fact I got less than 10hours of work for a whole month since I joined the program from August 2019. I have emailed to ask the team a few times about the availability of tasks but the answers are the same over time that I should check the raterhub regularly.
Do you know or exprience this situation? Please advise if the tasks situation would get better in the future. Thanks!
Is your role called Internet Safety Evaluator?
Hi, Tim
I just joined the Yukon Appen project last month and my project status is currently at New Evaluator Level 3. How do I get into unrestricted level?
Hello,
Normally restriction in terms of working hours are removed after receiving positive Side by Side and PQ feedback. The next Side by Side will be published in the end of this month.
Hi Tim,
I sent email to General Support > Quality team yesterday and this morning they reply my email and said :
Thank you for your inquiry.
I was able to unrestrict your account after checking the accuracy of your ratings and comments.
Please let us know if we can be of any further help.
Kind Regards,
Your support team
Suddenly, my level rise to Unrestricted level without having to wait for PQ and Side by Side feedback quality in the end of month. How is it possible? Should I send email earlier?
Hi there, I don’t know if this is the right place to ask this but I’ve been working for appen since a year and I’m on unrestricted level, the fact is that I have been sent an invitation for annotation and transcription projects twice, seems like I can’t pass the exam, it’s like there are a few questions which are not explained in the guidelines like if you hear someone’s name is mark how do you transcript it??? Are there any posts regarding this kind of projects?
Thank you
This project does not worth any effort, strongly recommend you to switch your attention to any search engine evaluation projects if available any.
Hey tim, what are the restrictions for Intent Safety Evaluator after they are transferred to fully video rating program? Do they only get videos tasks now and forget about all variety of tasks they used to get during their first 3 months?
Yes, correct, Internet Safety Evaluator is Youtube video evaluation project, in this project raters will not get typical Yukon/Internet Assessor tasks.
Hey Tim,
I joined the LB in Internet Safety Program since April 2019.
Until now there is only 1 hour task available in daily basis? When I emailed them, they just stated I’m in transition program, do the task that available :(. One hour per day for about 9 month is not a pleasant situation. Do you have any information when they finally ends this transition ?
Believe me, you would like to stay in this transition period. After transition to video safety is completed, there is hardly any work throughout the day as the video tasks are low in volume. I hardly get 15 min of daily work that too at specific time, if I miss that time then no work for that day. Upon asking they clarified that in several weeks, the volume will increase. Lets hope for the best.
What is your locale? I have the opposite information, after the transition period is over, the amount of tasks will increase significantly.
Hi Tim, my locale is English India. I was transferred to video safety at the start of this month. I was not able to reply to your message, so I replied here. Thanks.
The probation period will last about 3-4 months during this period your work will be checked for quality.
How long have you been in transition program?
My locale is Indonesia. I have been waiting for 9 months in this transition phase 😭
Tim, yes I was on probation since July and worked for 4 months before the final transition took place this month. I scored well above the required score for all months on reviews too.
Hi Jack
Does it mean you have received email from LB that state your transition already completed and become a full rater on ISE project ?
In my case since joined the ISE on April 2019, i put on transition program on May 2019 until now. There is no clue or timeline when it will completed. During this transition I just allowed to acquire task for 1 hours per day.
Yes Qiqi, the transition is completed but I am full rater only for video ratings as I mentioned earlier. So the variety has decreased altogether to video tasks only and they are very scarce as of now.
Thanks Jack,
At least your new status as full rater for video task already permanent. Your transition phase just take 4-5 months. Look at me I have waiting this almost a year 🙁
Hope the volume of your new task will increase soon.
Yes Qiqi, it will only be worth if the volume increases for this new transition. Else the transition period was better.
Hi Tim. New PT rater at Appen since 21th Jan, restricted 2 hours per day with a weekly 8 hours minimum required;
already manage to pass to level 2 where now I can work 3 hours per day with weekly 10 hours minimum.
One question, can I work from another place rather than my house (i.e. parents house at weekend/ hollidays house) without any “IP scam”? I can access the raterhub, but didn’t tried to adquire task although it seems to be possible…
I think I remember that it was told somewhere we would be restricted to the registered IP at time of the contract, but can’t find that information at Appen or Yukon page… by the way, just for sharing the info they are paying 8,25$ at Portugal and the previous 250$ bonus now is for US-based candidates only. thanks in advance.
Hello,
Thank you for your feedback!
IP ADDRESS CHANGE AND NETWORK SHARING WHILE WORKING IN APPEN YUKON AND LIONBRIDGE PROJECTS
In some cases people may share their network, while working as search engine evaluator, this case leads to IP address conflict and removal from the project. Make sure that you have your personal unique IP address and no one uses the same IP to go online for rating project.
When rating tasks on raterhub platform you may change your IP address many times, it will not affect your project status. Make sure that you do your project tasks in a private place and in a country of your project locale.
Hello, Tim.
My name is Victor. Thank you a lot for your blog, it’s really very helpful. I’m sure I have passed the Yukon exams not without your blog’s help.
Yeah, I’ve passed the exam but it is not clear what next. I don’t understand what is going on. I really don’t know what to do. So I decided to write you this email – something tells me you can help me with at least advice.
Sorry for my English. It’s not perfect, because it’s not my native language. I’m from Russia.
I apologize in advance, because most likely this email will be large. But I
think it’s necessary to describe my situation. I hope for your
understanding and your help.
I have passed the Yukon exams in Appen and received two emails informing about this on February 3. Now is February 13 and I didn’t even start working in the Yukon project:
1. The first email started with the words “Congratulations on passing the Yukon exam!
We have not been able to confirm that you have downloaded the Raterhub mobile app. If not please follow the directions below, if you have please provide a screenshot so that we may confirm.”
And there are some links to raterhub.com pages. But I can’t open them – I tried on both mobile and computer. All I see is “Error 404”.
In the text of the email and in the PDF instruction it was mentioned the following:
“Before installing the Rater Hub app, you must first become a tester by joining the Rater Hub group. Please access this link … on your desktop computer, making sure you are logged in to the account associated with your Rater Hub account.”
“If you are having issues installing the Android app, please make sure that you have first opted into a mobile user group on raterhub.com.”
So I tried to open the page indicated in the email. This page says that I should be invited to a Google group and I have to accept the invitation.
But I have not received any invitations to any group. Can you invite me again to necessary group which will give me access to the Raterhub and its app.
I wrote two emails to Appen support about this, but I received no intelligible answer to my questions. And I didn’t received any invitation to group. Appen support answered me about some troubleshooting steps raters can take to try to get the app to connect but now I don’t need to connect raterhub app – I can’t download it. I don’t have the access to all raterhub pages. The next reply of the support was more off topic than previous.
Question: Tim, can you tell please, maybe I do something wrong?! The answer may possibly be found in the second email:
2. The second email started with the words “Congratulations, you have passed the Project Yukon qualification exam!
Your access to the Rater Hub will be temporarily removed until we finalize
your Appen paperwork.”
I read in article, they had to ask me to sign several electronic forms, and after 2-4 days I had to get access to live tasks. But I didn’t sign any forms, 10 days have passed and I still have not received any email from them about my work in Yukon project.
Also this email contained the links to the Project Yukon homepage and the Appen chat server. But all these links lead to error page with the following text:
“Access Denied
We’re sorry, you do not have permission to access this page. That is, if it even exists.
Please use your browser’s back button to return to the page you were viewing.”
I have send emails to Appen support but again did not receive any intelligible answer.
Question: Tim, can you tell me please how long does it take to finalize my Appen paperwork? Could this paperwork affect my ability to download the Raterhub app and my access to other pages on the Appen website?
3. And some of my observations (maybe they can help you to help me):
I can login to Appen page and see all projects, but there is no Yukon project anymore there. Also I don’t see Yukon project in my active processes.
Question: Tim, does it mean I should forget about working in the Yukon project? Or it’s ok that the Yukon project is no longer in my active processes?! Maybe I should try to qualify for another project?! But there are no guarantees that will not work out the same way as with the Yukon project.
Tim, thank you in advance. I hope you help me, maybe with advice, maybe with recommendation.
Have a nice day!
Sincerely,
Victor.
Hello,
Unfortunately if the project disappeared from your current active processes and appen connect project list it means that this project is no longer available for you.
You cannot do anything about it, my advise in this case is to apply for the similar role at Lionbridge.
Thank you, Tim, for the answer.
Tim, can you help me please with another question:
I have now 4 projects in progress. All these 4 projects had the following text in the description: “You must complete any in-progress qualifications before you can work on this project.”.
I just have qualified for the fifth project. Does it mean if this text in the descritions didn’t dissappear I have to complete another project? Or this text will never disappear and now I have chance to get job in one of these 4 projects?!
Tim, thank you in advance.
Sincerely, Victor.
Hello,
Yes, if project status is in progress it means that at some point you will be invited for project qualification.
Hello-
A new vertical appeared in my appen SRT, compound eye. It’s listing something called, Music Q&A Blind Set Collection.
I have no idea what project to which this is attached or what I should do with it. Any words?
Thank you-
Shane Holland