Error while running TfsTestPlansAndSuitesMigrationProcessor #2381

xci-mrt · 2024-09-23T06:36:17Z

xci-mrt
Sep 23, 2024

Hi, im Trying to migrate our testplans and suites. but keeps getting an error, and have tried almost everything. so hoped someone had the golden path to how to get it working.

[08:07:52 DBG] [16.0.1] ===================================
[08:07:52 DBG] [16.0.1] Configuring 'MigrationTools:Processors:0:Enrichers'
[08:07:52 DBG] [16.0.1] ===================================
[08:07:52 DBG] [16.0.1] ===================================
[08:07:52 DBG] [16.0.1] Configuring 'MigrationTools:Processors:1:Enrichers'
[08:07:52 DBG] [16.0.1] ===================================
[08:07:52 DBG] [16.0.1] ===================================
[08:07:52 DBG] [16.0.1] Configuring 'MigrationTools:Processors:2:Enrichers'
[08:07:52 DBG] [16.0.1] ===================================
[08:07:52 INF] [16.0.1] Creating Migration Engine 5ac9e8f4-7299-44b7-b1f8-c64a5386778e
[08:07:52 INF] [16.0.1] ProcessorContainer: Of 3 configured Processors only 3 are enabled
[08:07:52 INF] [16.0.1] ProcessorContainer: Adding Processor TfsTestPlansAndSuitesMigrationProcessor
[08:07:52 DBG] [16.0.1] Constructor found: IOptions`1, TfsCommonTools, ProcessorEnricherContainer, IServiceProvider, ITelemetryLogger, ILogger`1
[08:07:52 DBG] [16.0.1] Attempting to pass parameters: OptionsWrapper`1
[08:07:52 DBG] [16.0.1] ===================================
[08:07:52 DBG] [16.0.1] Configuring 'MigrationTools:CommonTools:FieldMappingTool:FieldMaps'
[08:07:52 DBG] [16.0.1] ===================================
[08:07:52 INF] [16.0.1] ProcessorContainer: Adding Processor TfsTestVariablesMigrationProcessor
[08:07:52 DBG] [16.0.1] Constructor found: IOptions`1, CommonTools, ProcessorEnricherContainer, IServiceProvider, ITelemetryLogger, ILogger`1
[08:07:52 DBG] [16.0.1] Attempting to pass parameters: OptionsWrapper`1
[08:07:52 INF] [16.0.1] ProcessorContainer: Adding Processor TfsTestConfigurationsMigrationProcessor
[08:07:52 DBG] [16.0.1] Constructor found: IOptions`1, TfsCommonTools, ProcessorEnricherContainer, IServiceProvider, ITelemetryLogger, ILogger`1
[08:07:52 DBG] [16.0.1] Attempting to pass parameters: OptionsWrapper`1
[08:07:52 INF] [16.0.1] Logging has been configured and is set to: unknown.
[08:07:52 INF] [16.0.1]                               Max Logfile: Verbose.
[08:07:52 INF] [16.0.1]                               Max Console: Debug.
[08:07:52 INF] [16.0.1]                  Max Application Insights: Error.
[08:07:52 INF] [16.0.1] The Max log levels above show where to go look for extra info. e.g. Even if you set the log level to Verbose you will only see that info in the Log File, however everything up to Debug will be in the Console.
[08:07:52 INF] [16.0.1] Beginning run of 3 processors
[08:07:52 INF] [16.0.1] Processor: TfsTestPlansAndSuitesMigrationProcessor
[08:07:52 INF] [16.0.1] Migration Context Start: TfsTestPlansAndSuitesMigrationProcessor
[08:07:52 DBG] [16.0.1] TfsMigrationClient::GetDependantTfsCollection:AuthenticationMode(Prompt)
[08:07:52 INF] [16.0.1] Prompting for credentials
[08:07:52 DBG] [16.0.1] MigrationClient: Connecting to http://xxx:8080/tfs/xxx DefaultCollection
[08:07:53 INF] [16.0.1] Access granted to http://xxx:8080/tfs/xxx DefaultCollection for Morten Thomsen (xxx\xxx)
[08:07:53 DBG] [16.0.1] TfsMigrationClient::GetDependantTfsCollection:AuthenticationMode(Prompt)
[08:07:53 INF] [16.0.1] Prompting for credentials
[08:07:53 DBG] [16.0.1] MigrationClient: Connecting to http://xxx:8080/tfs/xxx Migration Performance Test/
[08:07:53 INF] [16.0.1] Access granted to http://xxx:8080/tfs/xxx Migration Performance Test/ for Morten Thomsen (xxx\xxx)
[08:07:53 INF] [16.0.1] Migrating all Nodes before the Processor run.
[08:07:53 DBG] [16.0.1] NodeStructureEnricher.MigrateAllNodeStructures(@MigrationTools.Tools.NodeOptions, @MigrationTools.Tools.NodeOptions)
[08:07:53 DBG] [16.0.1] NodeStructureEnricher.ProcessCommonStructure(Area, Area)
[08:07:53 DBG] [16.0.1] Source Node Path StartsWith [\xxx\area]
[08:07:53 DBG] [16.0.1] NodeStructureEnricher.GetNewNodeName(xxx\DecodeX, Area)
[08:07:53 DBG] [16.0.1] NodeStructureEnricher.GetNewNodeName::Mappers
Error logged to Elmah.io!
!! Check for latest version - We fix issues constantly - If not, please create a discussion on https://github.com/nkdAgility/azure-devops-migration-tools/discussions so we can get this fixed !!
[08:07:53 FTL] [16.0.1] Error while running TfsTestPlansAndSuitesMigrationProcessor
System.NullReferenceException: Object reference not set to an instance of an object.
   at MigrationTools.Tools.TfsNodeStructureTool.GetNewNodeName(String sourceNodePath, TfsNodeStructureType nodeStructureType) in D:\a\azure-devops-migration-tools\azure-devops-migration-tools\src\MigrationTools.Clients.TfsObjectModel\Tools\TfsNodeStructureTool.cs:line 111
   at MigrationTools.Tools.TfsNodeStructureTool.CreateNodes(XmlNodeList nodeList, String treeType, TfsNodeStructureType nodeStructureType) in D:\a\azure-devops-migration-tools\azure-devops-migration-tools\src\MigrationTools.Clients.TfsObjectModel\Tools\TfsNodeStructureTool.cs:line 349
   at MigrationTools.Tools.TfsNodeStructureTool.ProcessCommonStructure(String treeTypeSource, String localizedTreeTypeName, String projectTarget, TfsNodeStructureType nodeStructureType) in D:\a\azure-devops-migration-tools\azure-devops-migration-tools\src\MigrationTools.Clients.TfsObjectModel\Tools\TfsNodeStructureTool.cs:line 468
   at MigrationTools.Tools.TfsNodeStructureTool.MigrateAllNodeStructures() in D:\a\azure-devops-migration-tools\azure-devops-migration-tools\src\MigrationTools.Clients.TfsObjectModel\Tools\TfsNodeStructureTool.cs:line 400
   at MigrationTools.Tools.TfsNodeStructureTool.ProcessorExecutionBegin(TfsProcessor processor) in D:\a\azure-devops-migration-tools\azure-devops-migration-tools\src\MigrationTools.Clients.TfsObjectModel\Tools\TfsNodeStructureTool.cs:line 278
   at MigrationTools.Processors.TfsTestPlansAndSuitesMigrationProcessor.InternalExecute() in D:\a\azure-devops-migration-tools\azure-devops-migration-tools\src\MigrationTools.Clients.TfsObjectModel\Processors\TfsTestPlansAndSuitesMigrationProcessor.cs:line 82
   at MigrationTools.Processors.Infrastructure.Processor.Execute() in D:\a\azure-devops-migration-tools\azure-devops-migration-tools\src\MigrationTools\Processors\Infrastructure\Processor.cs:line 105
[08:07:53 INF] [16.0.1] TfsTestPlansAndSuitesMigrationProcessor completed in 00:00:00
[08:07:53 ERR] [16.0.1] TfsTestPlansAndSuitesMigrationProcessor The Processor MigrationEngine entered the failed state...stopping run
[08:07:53 INF] [16.0.1] Command ExecuteMigrationCommand completed in 00:00:01.7760217

config file:



{
  "Serilog": {
    "MinimumLevel": "Debug"
  },
  "MigrationTools": {
    "Version": "16.0",
    "Endpoints": {
      "Source": {
        "EndpointType": "TfsTeamProjectEndpoint",
        "Collection": "http://xxx:8080/tfs/xxx%20DefaultCollection",
        "Project": "xxx",
        "Authentication": {
          "AuthenticationMode": "Prompt",
          "AccessToken": "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"
      },
        "ReflectedWorkItemIDFieldName": "Custom.ReflectedWorkItemId",
        "AllowCrossProjectLinking": false,
        "LanguageMaps": {
          "AreaPath": "Area",
          "IterationPath": "Iteration"
        },
        "EndpointEnrichers": null
      },
      "Target": {
        "EndpointType": "TfsTeamProjectEndpoint",
        "Collection": "http://xxx:8080/tfs/xxx%20Migration%20Performance%20Test/",
        "Project": "xxx",
        "ReflectedWorkItemIDFieldName": "Custom.ReflectedWorkItemId",
        "AllowCrossProjectLinking": false,
        "Authentication": {
          "AuthenticationMode": "Prompt",
          "AccessToken": "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"
        },
        "LanguageMaps": {
          "AreaPath": "Area",
          "IterationPath": "Iteration"
        },
        "EndpointEnrichers": null
      }
    },
    "Processors": [
      {
        "ProcessorType": "TfsTestPlansAndSuitesMigrationProcessor",
        "Enabled": true,
        "OnlyElementsWithTag": "null",
        "RemoveAllLinks": false,
        "MigrationDelay": 0,
        "RemoveInvalidTestSuiteLinks": false,
        "FilterCompleted": false,
        "SourceName": "Source",
        "TargetName": "Target"
      },
      {
        "ProcessorType": "TfsTestVariablesMigrationProcessor",
        "Enabled": true,
        "Processor": "TestVariablesMigrationContext",

        "Enrichers": null,
        "SourceName": "Source",
        "TargetName": "Target",
        "RefName": null
      },
      {
        "ProcessorType": "TfsTestConfigurationsMigrationProcessor",
        "Enabled": true,
        "Enrichers": null,
        "SourceName": "Source",
        "TargetName": "Target",
        "RefName": null
      }
    ],
    "CommonTools": {
      "TfsChangeSetMappingTool": {
        "Enabled": true,
        "ChangeSetMappingFile": ""
      },
      "TfsGitRepositoryTool": {
        "Enabled": true,
        "Mappings": null
      },
      "FieldMappingTool": {
        "Enabled": true,
        "FieldMaps": []
      }
    }
  }

Answered by MrHinsh

Sep 23, 2024

Looks like IsWellFormedUriString doe not like your URL.

Ive updated to:

 if (options.Collection == null)
 {
     errors.Add("The Collection property must not be null.");
 }
 else
 {
     Uri output;
     if (!Uri.TryCreate(options.Collection.ToString(), UriKind.Absolute, out output))
     {
         errors.Add("The Collection property must be a valid URL.");
     }

 }

Which should work for your URL as well...

Should be in v16.0.4-Preview.5

View full answer

2024-09-23T07:54:57Z

nkdagility-actions-bot[bot]
bot Sep 23, 2024

Hi there,

You're reporting a problem with an old version of the Azure DevOps Migration Tools. Please try the latest version and tell us if that fixes your problem. Bonus points for also trying with the latest preview version.

Good luck,

Thanks, Azure DevOps Migration Tools team

0 replies

xci-mrt · 2024-09-23T08:38:27Z

xci-mrt
Sep 23, 2024
Author

Thanks you for that, tried the 16.0.3 and latest. and now getting an error that the target url is not valid.. never gotten this before.

   ___  __  __   ___    ___   _   _  | |_    ___
  / _ \ \ \/ /  / _ \  / __| | | | | | __|  / _ \
 |  __/  >  <  |  __/ | (__  | |_| | | |_  |  __/
  \___| /_/\_\  \___|  \___|  \__,_|  \__|  \___|

[10:32:16 DBG] [16.0.3] ===================================
[10:32:16 DBG] [16.0.3] Configuring 'MigrationTools:Processors:0:Enrichers'
[10:32:16 DBG] [16.0.3] ===================================
[10:32:16 DBG] [16.0.3] ===================================
[10:32:16 DBG] [16.0.3] Configuring 'MigrationTools:Processors:1:Enrichers'
[10:32:16 DBG] [16.0.3] ===================================
[10:32:16 INF] [16.0.3] No validator found for processor type TfsTestVariablesMigrationProcessorOptions
[10:32:16 DBG] [16.0.3] ===================================
[10:32:16 DBG] [16.0.3] Configuring 'MigrationTools:Processors:2:Enrichers'
[10:32:16 DBG] [16.0.3] ===================================
[10:32:16 INF] [16.0.3] No validator found for processor type TfsTestConfigurationsMigrationProcessorOptions
[10:32:16 INF] [16.0.3] Creating Migration Engine 4ea528f3-a2d1-417f-98b8-60306134a6c5
[10:32:16 INF] [16.0.3] ProcessorContainer: Of 3 configured Processors only 3 are enabled
[10:32:16 INF] [16.0.3] ProcessorContainer: Adding Processor TfsWorkItemMigrationProcessor
[10:32:16 DBG] [16.0.3] Constructor found: IOptions`1, TfsCommonTools, ProcessorEnricherContainer, IServiceProvider, ITelemetryLogger, ILogger`1
[10:32:16 DBG] [16.0.3] Attempting to pass parameters: OptionsWrapper`1
[10:32:16 DBG] [16.0.3] ===================================
[10:32:16 DBG] [16.0.3] Configuring 'MigrationTools:CommonTools:FieldMappingTool:FieldMaps'
[10:32:16 DBG] [16.0.3] ===================================
[10:32:16 INF] [16.0.3] ProcessorContainer: Adding Processor TfsTestVariablesMigrationProcessor
[10:32:16 DBG] [16.0.3] Constructor found: IOptions`1, CommonTools, ProcessorEnricherContainer, IServiceProvider, ITelemetryLogger, ILogger`1
[10:32:16 DBG] [16.0.3] Attempting to pass parameters: OptionsWrapper`1
[10:32:16 INF] [16.0.3] ProcessorContainer: Adding Processor TfsTestConfigurationsMigrationProcessor
[10:32:16 DBG] [16.0.3] Constructor found: IOptions`1, TfsCommonTools, ProcessorEnricherContainer, IServiceProvider, ITelemetryLogger, ILogger`1
[10:32:16 DBG] [16.0.3] Attempting to pass parameters: OptionsWrapper`1
[10:32:16 INF] [16.0.3] Logging has been configured and is set to: unknown.
[10:32:16 INF] [16.0.3]                               Max Logfile: Verbose.
[10:32:16 INF] [16.0.3]                               Max Console: Debug.
[10:32:16 INF] [16.0.3]                  Max Application Insights: Error.
[10:32:16 INF] [16.0.3] The Max log levels above show where to go look for extra info. e.g. Even if you set the log level to Verbose you will only see that info in the Log File, however everything up to Debug will be in the Console.
[10:32:16 INF] [16.0.3] Beginning run of 3 processors
[10:32:16 INF] [16.0.3] Processor: TfsWorkItemMigrationProcessor
[10:32:16 INF] [16.0.3] Migration Context Start: TfsWorkItemMigrationProcessor
[10:32:16 DBG] [16.0.3] WorkItemMigrationContext::InternalExecute
Error logged to Elmah.io!
!! Check for latest version - We fix issues constantly - If not, please create a discussion on https://github.com/nkdAgility/azure-devops-migration-tools/discussions so we can get this fixed !!
[10:32:16 FTL] [16.0.3] Validation of your configuration failed:
The configuration entry at 'MigrationTools:Endpoints:Target' did not pass validation!
 Please check the following failures:
 -The Collection property must be a valid URL.
[10:32:16 INF] [16.0.3] TfsWorkItemMigrationProcessor completed in 00:00:00
[10:32:16 ERR] [16.0.3] TfsWorkItemMigrationProcessor The Processor MigrationEngine entered the failed state...stopping run
[10:32:16 INF] [16.0.3] Command ExecuteMigrationCommand completed in 00:00:00.7801544

CONFIG:

        "EndpointType": "TfsTeamProjectEndpoint",
        "Collection": "http://tfs01.dev.local:8080/tfs/DEV%20Migration%20Performance%20Test/",
        "Project": "xcisw",
        "ReflectedWorkItemIdField": "Custom.ReflectedWorkItemId",
        "AllowCrossProjectLinking": false,
        "Authentication": {
          "AuthenticationMode": "Prompt",
          "AccessToken": "MYPATCODE"
        },```

6 replies

xci-mrt Sep 23, 2024
Author

and is it correct the ConfigSamples not workin with 16 branch?

MrHinsh Sep 23, 2024
Maintainer

odd . its hitting:

// Validate Collection - Required and must be a valid URL
if (options.Collection == null)
{
    errors.Add("The Collection property must not be null.");
}
else if (!Uri.IsWellFormedUriString(options.Collection.ToString(), UriKind.Absolute))
{
    errors.Add("The Collection property must be a valid URL.");
}

p.s. its 3*` not 1 for multi-line.

MrHinsh Sep 23, 2024
Maintainer

Alos your URL is odd @xci-mrt, is DEV%20Migration%20Performance%20Test a project name? The collection is "tfs" right?

MrHinsh Sep 23, 2024
Maintainer

Looks like IsWellFormedUriString doe not like your URL.

Ive updated to:

 if (options.Collection == null)
 {
     errors.Add("The Collection property must not be null.");
 }
 else
 {
     Uri output;
     if (!Uri.TryCreate(options.Collection.ToString(), UriKind.Absolute, out output))
     {
         errors.Add("The Collection property must be a valid URL.");
     }

 }

Which should work for your URL as well...

Should be in v16.0.4-Preview.5

Answer selected by xci-mrt

xci-mrt Sep 24, 2024
Author

Thanks for the quick reply,
The collection name is: DEV%20Migration%20Performance%20Test
the project is xcisw.

i will try the the preview-5 when its released, and idea on when it will be released?

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Error while running TfsTestPlansAndSuitesMigrationProcessor #2381

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 2 comments 6 replies

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

Select a reply

Error while running TfsTestPlansAndSuitesMigrationProcessor #2381

xci-mrt Sep 23, 2024

Replies: 2 comments · 6 replies

nkdagility-actions-bot[bot] bot Sep 23, 2024

xci-mrt Sep 23, 2024 Author

xci-mrt Sep 23, 2024 Author

MrHinsh Sep 23, 2024 Maintainer

MrHinsh Sep 23, 2024 Maintainer

MrHinsh Sep 23, 2024 Maintainer

xci-mrt Sep 24, 2024 Author

xci-mrt
Sep 23, 2024

Replies: 2 comments 6 replies

nkdagility-actions-bot[bot]
bot Sep 23, 2024

xci-mrt
Sep 23, 2024
Author

xci-mrt Sep 23, 2024
Author

MrHinsh Sep 23, 2024
Maintainer

MrHinsh Sep 23, 2024
Maintainer

MrHinsh Sep 23, 2024
Maintainer

xci-mrt Sep 24, 2024
Author