Advanced search

Message boards : News : updates to validation

Author Message
Travis Desell
Volunteer moderator
Project administrator
Project developer
Project scientist
Send message
Joined: 16 Jan 12
Posts: 1813
Combined Credit: 23,514,257
DNA@Home: 293,563
SubsetSum@Home: 349,212
Wildlife@Home: 22,871,482
Wildlife@Home Watched: 212,926s
Wildlife@Home Events: 51
Climate Tweets: 21
Images Observed: 774

              
Message 999 - Posted: 16 Aug 2013, 6:53:19 UTC
Last modified: 16 Aug 2013, 6:55:08 UTC

The validator will now accept a quorum of two observations, I've re-ran validation over all the observations and found that with a quorum of 2, the credit is practically the same. So I think things should be smooth from here on out. You won't have to watch any videos that might have previously been validated.

If you think anything isn't working right with this current scheme and validator (like you notice things going unvalidated that should be validated, or things that validated which shouldnt) let me know. I hope to have the report button working tomorrow.

Thanks for bearing with me during all these validator updates.

Profile STE\/E
Avatar
Send message
Joined: 5 Apr 13
Posts: 416
Combined Credit: 29,783,819
DNA@Home: 2,634,206
SubsetSum@Home: 735,231
Wildlife@Home: 26,414,382
Wildlife@Home Watched: 53,380,530s
Wildlife@Home Events: 9,349
Climate Tweets: 0
Images Observed: 0

          
Message 1000 - Posted: 16 Aug 2013, 9:12:07 UTC

I seen a big jump in the BOSSA Credits then about a 31k drop several Hr's later, if that's all it's going to be it's no big deal & I can live with that. I have noticed that 4-5 People including myself have already watched all the Videos I'm watching now. Some of that is because of obvious mistakes in Marking them but some of them all 4 or 5 are in agreement with the markings ... Their the Plover Videos
____________

Profile DoctorNow
Avatar
Send message
Joined: 31 Jan 12
Posts: 328
Combined Credit: 2,333,912
DNA@Home: 94,617
SubsetSum@Home: 162,940
Wildlife@Home: 2,076,355
Wildlife@Home Watched: 1,977,485s
Wildlife@Home Events: 589
Climate Tweets: 128
Images Observed: 2,678

              
Message 1001 - Posted: 16 Aug 2013, 9:32:40 UTC
Last modified: 16 Aug 2013, 9:33:34 UTC

Looks like this revalidation is still running. I looked about half an hour to it as I read the news and wondered that I had this less credit, so I almost would have asked what is changed on the credit site, but work hindered me to do that.
Now I see my credits have changed again, so it seems to be still working.
How long can this take until it's completed, Travis?
____________
Wildlife & SubsetSum Badges-creator ;-)
Mod/Guru @ the german team BOINC@Heidelberg
My BOINC-Stats / My Badges

Travis Desell
Volunteer moderator
Project administrator
Project developer
Project scientist
Send message
Joined: 16 Jan 12
Posts: 1813
Combined Credit: 23,514,257
DNA@Home: 293,563
SubsetSum@Home: 349,212
Wildlife@Home: 22,871,482
Wildlife@Home Watched: 212,926s
Wildlife@Home Events: 51
Climate Tweets: 21
Images Observed: 774

              
Message 1005 - Posted: 16 Aug 2013, 13:13:02 UTC - in response to Message 1001.

Looks like this revalidation is still running. I looked about half an hour to it as I read the news and wondered that I had this less credit, so I almost would have asked what is changed on the credit site, but work hindered me to do that.
Now I see my credits have changed again, so it seems to be still working.
How long can this take until it's completed, Travis?


Should be all done now.

Profile Lemon
Send message
Joined: 10 May 13
Posts: 229
Combined Credit: 476,659
DNA@Home: 190,781
SubsetSum@Home: 225,957
Wildlife@Home: 59,921
Wildlife@Home Watched: 11,190,214s
Wildlife@Home Events: 0
Climate Tweets: 0
Images Observed: 0

        
Message 1006 - Posted: 16 Aug 2013, 13:24:30 UTC - in response to Message 999.

If you think anything isn't working right with this current scheme and validator (like you notice things going unvalidated that should be validated, or things that validated which shouldnt) let me know.

In going through my watched videos, I've noticed several videos where all watchers are UNVALIDATED even though two or even three of the viewers all have the same markings (with no Unsures). An example is:

Profile DoctorNow
Avatar
Send message
Joined: 31 Jan 12
Posts: 328
Combined Credit: 2,333,912
DNA@Home: 94,617
SubsetSum@Home: 162,940
Wildlife@Home: 2,076,355
Wildlife@Home Watched: 1,977,485s
Wildlife@Home Events: 589
Climate Tweets: 128
Images Observed: 2,678

              
Message 1008 - Posted: 16 Aug 2013, 13:36:36 UTC - in response to Message 1005.

Should be all done now.

Then I'm really surprised why I lost around 80.000 bossa credits. I don't think I have had that much videos wrong... :-\
Looks like I have to go through all the videos again when the report-button works to see what was up there.
And I already found 1 now by a fast look which I had absolutely correct, but was invalid because others marked it wrong...
____________
Wildlife & SubsetSum Badges-creator ;-)
Mod/Guru @ the german team BOINC@Heidelberg
My BOINC-Stats / My Badges

Profile Lemon
Send message
Joined: 10 May 13
Posts: 229
Combined Credit: 476,659
DNA@Home: 190,781
SubsetSum@Home: 225,957
Wildlife@Home: 59,921
Wildlife@Home Watched: 11,190,214s
Wildlife@Home Events: 0
Climate Tweets: 0
Images Observed: 0

        
Message 1009 - Posted: 16 Aug 2013, 13:55:11 UTC - in response to Message 1008.

Then I'm really surprised why I lost around 80.000 bossa credits. I don't think I have had that much videos wrong... :-\
Looks like I have to go through all the videos again when the report-button works to see what was up there.
And I already found 1 now by a fast look which I had absolutely correct, but was invalid because others marked it wrong...

I wouldn't worry too much about any loss of credits at this point. If you had indeed marked a video correctly but it it now marked invalid, you will have the ability to report the video and get the credits back.

Also, many videos which had previously been validated are now unvalidated. These mostly seem to be videos where the canonical markings had included Unsure. The problem was that if the canonical marking included Unsure, it was possible for both Yes and No markings to be valid.

As these videos get pushed through Susan and her students, we will get credited for them, I'm sure.

Profile DoctorNow
Avatar
Send message
Joined: 31 Jan 12
Posts: 328
Combined Credit: 2,333,912
DNA@Home: 94,617
SubsetSum@Home: 162,940
Wildlife@Home: 2,076,355
Wildlife@Home Watched: 1,977,485s
Wildlife@Home Events: 589
Climate Tweets: 128
Images Observed: 2,678

              
Message 1012 - Posted: 16 Aug 2013, 14:46:54 UTC - in response to Message 1009.

Also, many videos which had previously been validated are now unvalidated. These mostly seem to be videos where the canonical markings had included Unsure. The problem was that if the canonical marking included Unsure, it was possible for both Yes and No markings to be valid.

As these videos get pushed through Susan and her students, we will get credited for them, I'm sure.

I see, just took a look at the unvalidated ones. I have a whole bunch of them, that explains it... ;-)
____________
Wildlife & SubsetSum Badges-creator ;-)
Mod/Guru @ the german team BOINC@Heidelberg
My BOINC-Stats / My Badges

Travis Desell
Volunteer moderator
Project administrator
Project developer
Project scientist
Send message
Joined: 16 Jan 12
Posts: 1813
Combined Credit: 23,514,257
DNA@Home: 293,563
SubsetSum@Home: 349,212
Wildlife@Home: 22,871,482
Wildlife@Home Watched: 212,926s
Wildlife@Home Events: 51
Climate Tweets: 21
Images Observed: 774

              
Message 1013 - Posted: 16 Aug 2013, 14:47:51 UTC - in response to Message 1008.

Should be all done now.

Then I'm really surprised why I lost around 80.000 bossa credits. I don't think I have had that much videos wrong... :-\
Looks like I have to go through all the videos again when the report-button works to see what was up there.
And I already found 1 now by a fast look which I had absolutely correct, but was invalid because others marked it wrong...


Going through the database, you have 4186 valid observations and 244 invalid observations, so almost a 95% valid rate. You have 4741 total observations in the database (so approximately 400 not validated yet).

Some quick math, assuming most of the videos are 180 second duration:

180 * 4186 = 753,480 credit. Right now it looks like you have 734883 credit, so that's not too far off (considering less credit for observations with unsure, etc).

Basically the old validation strategy was re-awarding credit multiple times for the same observation, which is why current credit for everyone is less than it used to be.

Profile DoctorNow
Avatar
Send message
Joined: 31 Jan 12
Posts: 328
Combined Credit: 2,333,912
DNA@Home: 94,617
SubsetSum@Home: 162,940
Wildlife@Home: 2,076,355
Wildlife@Home Watched: 1,977,485s
Wildlife@Home Events: 589
Climate Tweets: 128
Images Observed: 2,678

              
Message 1017 - Posted: 16 Aug 2013, 15:14:47 UTC - in response to Message 1013.

You have 4741 total observations in the database (so approximately 400 not validated yet).

311 unvalidated ones to be precise, as I saw some minutes ago. ;-)
That would be 55,980 if every one of them would validate, so adding that to my current 734,883 it would be about 790,863.
I'm okay with that, no worries anyway, I'm an ATA somehow and I've undergone a lot of other "hardships" since I'm BOINCing. :-)
____________
Wildlife & SubsetSum Badges-creator ;-)
Mod/Guru @ the german team BOINC@Heidelberg
My BOINC-Stats / My Badges

Travis Desell
Volunteer moderator
Project administrator
Project developer
Project scientist
Send message
Joined: 16 Jan 12
Posts: 1813
Combined Credit: 23,514,257
DNA@Home: 293,563
SubsetSum@Home: 349,212
Wildlife@Home: 22,871,482
Wildlife@Home Watched: 212,926s
Wildlife@Home Events: 51
Climate Tweets: 21
Images Observed: 774

              
Message 1018 - Posted: 16 Aug 2013, 15:36:29 UTC - in response to Message 1017.

You have 4741 total observations in the database (so approximately 400 not validated yet).

311 unvalidated ones to be precise, as I saw some minutes ago. ;-)
That would be 55,980 if every one of them would validate, so adding that to my current 734,883 it would be about 790,863.
I'm okay with that, no worries anyway, I'm an ATA somehow and I've undergone a lot of other "hardships" since I'm BOINCing. :-)


I just added some more information to the watched videos page. If you take a look at it:

http://volunteer.cs.und.edu/wildlife/user_video_list.php

At the top it will say how many observations you've made, your total credit, your average credit per observation, as well as the number of valid, invalid and observations waiting for validation. That should give you an idea of how things are validating and if anything is wonky with your current credit.

GLeeM
Send message
Joined: 1 Jul 13
Posts: 118
Combined Credit: 47,541,025
DNA@Home: 28,994
SubsetSum@Home: 231,079
Wildlife@Home: 47,280,952
Wildlife@Home Watched: 3,888,714s
Wildlife@Home Events: 628
Climate Tweets: 0
Images Observed: 0

          
Message 1228 - Posted: 23 Aug 2013, 13:07:14 UTC - in response to Message 999.

you notice things going unvalidated that should be validated

In Lostwood:

We now need three to agree?

Or we need three to agree if the first two don't?

This morning I am seeing lots of videos where I am the fourth person watching!

Travis Desell
Volunteer moderator
Project administrator
Project developer
Project scientist
Send message
Joined: 16 Jan 12
Posts: 1813
Combined Credit: 23,514,257
DNA@Home: 293,563
SubsetSum@Home: 349,212
Wildlife@Home: 22,871,482
Wildlife@Home Watched: 212,926s
Wildlife@Home Events: 51
Climate Tweets: 21
Images Observed: 774

              
Message 1231 - Posted: 23 Aug 2013, 18:42:17 UTC - in response to Message 1228.
Last modified: 23 Aug 2013, 18:42:35 UTC

you notice things going unvalidated that should be validated

In Lostwood:

We now need three to agree?

Or we need three to agree if the first two don't?

This morning I am seeing lots of videos where I am the fourth person watching!


I think there were a couple that got set to require 3 views before validation. But two matching views should validate a video. If it's not happening let me know because that means I need to take a look at the validator.

Profile Lemon
Send message
Joined: 10 May 13
Posts: 229
Combined Credit: 476,659
DNA@Home: 190,781
SubsetSum@Home: 225,957
Wildlife@Home: 59,921
Wildlife@Home Watched: 11,190,214s
Wildlife@Home Events: 0
Climate Tweets: 0
Images Observed: 0

        
Message 1237 - Posted: 23 Aug 2013, 19:16:41 UTC - in response to Message 1231.

I think there were a couple that got set to require 3 views before validation. But two matching views should validate a video. If it's not happening let me know because that means I need to take a look at the validator.

There are still videos that need three to validate. Or rather, I have Unvalidated videos where someone else has already marked the video the same way I did.

I think the issue is that even though you have set the validator to only require two views, the validator doesn't validate a video until is it viewed again. As such, there are quite a few videos waiting for a third viewer.


Post to thread

Message boards : News : updates to validation