Nugetgallery: Add ambiguous packages to exception list

[ryuyu]

Steps:

• [ ] Enumerate all packages that are listed but have zero downloads due to issue described in https://github.com/NuGet/NuGet.Jobs/pull/82
• [ ] Add these to exceptions mapping in NuGet.Jobs.
• [ ] Redeploy Stats job.

[shishirx34]

Here are the packages matching the criteria for #1, 108 at the moment. NuGet/NuGet.Jobs#82 hasn't been merged yet. So will leave the list here for future ease.

__EDITED__: Removed faulty query. Updated with package list. There are 151 packages.
Packages:

ObjectPrinter-Log4Net-1.2.10
ObjectPrinter-Log4Net-1.2.12
ObjectPrinter-Log4Net-1.2.11
idea4work.ErrorReporting.4.5
msdn.4.5.2
gtk-sharp.Linux.3.14
Owin.Extensions.AspNet.WebApi.V2.2
RestSharp-Unity-NET-2.0
Oracle.DataAccess.x86.4
Qviljoen.OracleWeb.64
RealEstate3.0
TFS.14
BLTools.SQL.45
SQLitePCL.plugin.sqlite3.uap10.0
AjaxControlToolkit4.1.50731
Microsoft.VisualStudio.Modeling.Sdk.11.0
Microsoft.Practices.EnterpriseLibrary.2008
EasytechThemeMVC5.1
Aldsoft.Acord.LA.2.24.01
Aldsoft.Acord.LA.2.25.00
Aldsoft.Acord.LA.2.26.00
Aldsoft.Acord.LA.2.27.00
Aldsoft.Acord.LA.2.28.00
Aldsoft.Acord.LA.2.29.00
Aldsoft.Acord.LA.2.30.00
Aldsoft.Acord.LA.2.31.00
Aldsoft.Acord.LA.2.32.00
Aldsoft.Acord.LA.2.33.00
Aldsoft.Acord.LA.2.34.00
Aldsoft.Acord.LA.2.35.00
RPSv6.7
MB.MagicCMS.4.5
ESAPIX_13.6
DevExpress15.2
TrackableEntities.Patterns.EF.6
Microsoft.VisualStudio.Debugger.Interop.14.0
Microsoft.VisualStudio.Package.LanguageService.14.0
Microsoft.VisualStudio.Settings.14.0
Microsoft.VisualStudio.Shell.14.0
Microsoft.VisualStudio.Shell.Immutable.10.0
Microsoft.VisualStudio.Shell.Immutable.11.0
Microsoft.VisualStudio.Shell.Immutable.12.0
Microsoft.VisualStudio.Shell.Immutable.14.0
Microsoft.VisualStudio.TextTemplating.14.0
Microsoft.VisualStudio.TextTemplating.Interfaces.14.0
Microsoft.VisualStudio.TextTemplating.VSHost.14.0
iTextSharp-LGPL-BouncyCastle-1.8
Geckofx45.64
Microsoft.Office.Policy.14.0.0
SFML-Portable-2.1
SFML-Portable-2.2
SFML-Portable-2.3
Dguv.Kernpruefung.Uv-1.0
BenZoid.Readefine.SDK.64
itextsharp.4.1.6.0
1.111
Microsoft.VisualStudio.Sdk.BuildTasks.14.0
Gigya.Sitefinity.DS.9.0.6010
Gigya.Sitefinity.DS.9.1.6110
Gigya.Sitefinity.DS.9.2.6200
ObjectPrinter-Log4Net-1.2.13
NLog.Extensions.2
Algolia.Sitecore.8
Algolia.Sitecore.8.1
Microsoft.VisualStudio.Debugger.Interop.15.0
Microsoft.VisualStudio.Package.LanguageService.15.0
Microsoft.VisualStudio.Settings.15.0
Microsoft.VisualStudio.Shell.15.0
Microsoft.VisualStudio.Shell.Immutable.15.0
Microsoft.VisualStudio.TextTemplating.15.0
Microsoft.VisualStudio.TextTemplating.Interfaces.15.0
Microsoft.VisualStudio.TextTemplating.VSHost.15.0
Zoninn_JustClick_Utilities_V2.0
Zoninn_JustClick_XML_Utility_V2.0
Zoninn_JustClick_Authentication_V2
Zoninn_JustClick_Authentication_V2.1
Sitecore.Support.4177664
RSPL_FormatDate1.0.1
TypeaheadHelper.Bootstrap.3
ObjectPrinter-Log4Net-1.2.15
Codaxy.Dextop.6
DITS.HILI.WMS.Core.4.2
Bamboo1.0.0
Clints_Slack_API_1.2.3
TestV2FeedFindPackagesById.636221104695012440
TestV2FeedFindPackagesById.636221856830294475
TestMultipleVersion.636221863527191900
Sachin2.1
Microsoft.Office365.OutlookServices-V2.0
MyPackage_1.0.1
Microsoft.ReportViewer.Web.2012
1.0.0.0
Corpse.Reviver.1
Corpse.Reviver.2
jquery-globalize.0.1.3
opencv3.1
EmberJS.2.2
CopyHawk.Client.NET.4.0
boost_python2.7-vc120
McTools.Xrm.Connection.2015
McTools.Xrm.Connection.WinForms.2015
DLaB.Xrm.2015
XrmUnitTest.2015
FuzzyString1.0.1
BLTools.WPF.Controls.45
DLaB.Xrm.2016
XrmUnitTest.2016
MvcRouteTester.Mvc5.2
Tvl.VisualStudio.Commenter.Utility.10
Generic2.0
VSMSDK.Modeling.Sdk.14.0
VSMSDK.Modeling.Sdk.Diagrams.14.0
VSMSDK.Modeling.Sdk.Shell.14.0
Enyim.Memcached.1.2.0.8
HegaBots_Tools_1.0.1
Cream.1.0.0
SQLitePCLRaw.provider.winsqlite3.uap10.0
SQLitePCLRaw.provider.sqlite3.netstandard1.1
SQLitePCLRaw.provider.sqlite3.uap10.0
SQLitePCLRaw.provider.e_sqlite3.netstandard1.1
SQLitePCLRaw.provider.e_sqlite3.uap10.0
SQLitePCLRaw.provider.custom_sqlite3.netstandard1.1
SQLitePCLRaw.provider.custom_sqlite3.uap10.0
SQLitePCLRaw.provider.sqlcipher.netstandard1.1
SQLitePCLRaw.provider.sqlcipher.uap10.0
TMKjson9.0.1
Plugin.MyPlugin1.20160921
SAPB1DIAPI9.0
Xbim.PropertySets.4
DataDog-Client.Signed.2.2.0
SBSuite.TestPackages.Package3.1
SBSuite.TestPackages.Package2.1
SBSuite.TestPackages.Package1.1
SBSuite.TestPackages.Package1.2
SBSuite.TestPackages.Package1.3
Algolia.Sitecore.8.2
ClassLibrary3.1.0.0.0
Sitecore.Support.414299
Unity.WCF.4
Microsoft.Office.Server.14
ray-widget-0.0.1
ray-widget-0.0.2
odp.net.x64.v11.2.0.2.0
VecompSoftware.DocSuite.Public.Core.Models.4.5
VecompSoftware.DocSuite.Public.Helpers.4.5
DevExpress.v16.1
DevExpress.Mvvm.v16.2
SQLProvider.Signed.1.0.40
OAuthLogin2.0
scottbommarito.conflict.2
ESAPI_13.6

[dtivel]

You listed:

1.0.0.0

...as a package ID. Is that correct?

Also, your SQL LIKE expression will not return packages ending with a number greater than or equal to 10. For example, the query would not return a package named:

A.10

I don't know if there are any packages like this, but you can find them. Create this temporary function:

create function [dbo].[EndsWithDotNumber] (@packageName nvarchar(128))
returns bit
as
begin
    declare @index int = len(@packageName)
    declare @endsWithNumber bit = 0

    while @index > 0
    begin
        declare @char nchar = substring(@packageName, @index, 1)

        if (@char between N'0' and N'9')
        begin
            set @endsWithNumber = 1
        end
        else if (@endsWithNumber = 1 and @char = N'.')
        begin
            return 1
        end
        else
        begin
            break
        end

        set @index = @index - 1
    end

    return 0
end

Then modify the query to:

select PR.Id
from dbo.Packages P, dbo.PackageRegistrations PR
where P.DownloadCount = 0
    and PR.[Key] = P.PackageRegistrationKey
    and P.Listed = 'true'
    and [dbo].[EndsWithDotNumber](PR.[Id]) = 1
group by PR.Id

[xavierdecoster]

You listed:

1.0.0.0

... as a package ID. Is that correct?

I think so :) https://www.nuget.org/packages/1.0.0.0/

[shishirx34]

Thanks Damon. You are right, earlier I had the query to get the packages only ending in numbers, later realized that it needs to be .[number], missed it doesn't do regex match *. Will correct and update the package list.

[shishirx34]

Updated the list with correct packages ending in .[number]. We have 151 packages.

[joelverhagen]

From my calculations, there are 5,480 packages effected by this. This is a total of 2,706 unique IDs. Excluding packages produced by functional tests, this is 2,925 packages with a total of 762 unique IDs.
https://gist.github.com/joelverhagen/fde5a70d672620128da07c4a963c8ad4

I have no verified that all of these packages have zero downloads.

I think we need a real solution here.

[skofman1]

Fixed.