Dataturks – ML data annotations and labeling doesn't need to suck

Neat that you can look at and download the free projects.<p>One of the things I&#x27;d look for in a product like this is easily doing rater reliability &amp; interrater reliability.<p>Optimally I&#x27;d love to see a project also allow for easy semi-supervised labeling. I don&#x27;t see an API for grabbing data points for a model you are training to label and put them back.

The &quot;How does it work&quot; section doesn&#x27;t explain how it works.<p>&gt; You and your team can now easily collaborate to build ML datasets super quick. Send email invite to anyone to help label your datasets, your team, friends, colleagues or external labelers. Pre-built support for more than a dozen data annotation use cases.

Do you guys know if there is any open-source project doing this kind of thing (UI for image labeling, NLP tagging, classification)? I think I&#x27;ve seen something like this before.

Does Dataturks own the data after uploading&#x2F;labeling?<p>Do they keep copies?<p>That&#x27;s important because in ML, data is everything.

Does anyone have a good tool for pixel-level annotation? I was thinking an iPad app with pencil support might be nice, but open to whatever is out there.

Why do so few of these systems have integration with something like Mechanical Turk? Labeling your own data is a good way to get started, but often its a much better to just pay some people to annotate the data.

For work use, I&#x27;d need to host it on-prem. Otherwise even if it&#x27;s great, legal etc won&#x27;t let me use it.