This discussion has been locked.

You can no longer post new replies to this discussion. If you have a question you can start a new discussion

Mass Migration Using Importer

We do our migrations from a server, so its up and running non stop. The C: Drive of that server usually gets filled up as the migration goes on, causing problems when the drive gets completely full.

Are not the files being copied from the original location directly to the M-Files? Why is the C: drive being filled up? How does the process works?

Thanks.

Top Replies

DCPDamon over 3 years ago in reply to Moises +2 suggested

I don't see anything out of the ordinary here. I thought maybe it was a rogue logging setting, but you mostly use what I use and I've never filled up. As for finding the stuff taking up space, have you…

Parents

0 DCPDamon over 3 years ago

We imported hundreds of GBs of files before and it never touched the C drive. Can you tell what files are being added to the drive that are filling it up? Can you share your settings xml file so we can take a look? It could be some crazy logging you have enabled?
Cancel
Vote Up 0 Vote Down

Cancel

0 Moises over 3 years ago in reply to DCPDamon

The weird thing is that I cannot locate anything on the drive, but it does fill it up somehow.

We are moving these files to a cloud vault, not sure if that makes any difference.

Here is the XML used during that specific migration:

<?xml version="1.0" encoding="utf-8"?>
<ToolSettings xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
  <Name>Example Excel Settings for Excel Files</Name>
  <Description>This file contains example settings for M-Files Importer. It demonstrates how you can import data from an Excel file. You can test this with the Sample Vault.</Description>
  <GeneralOptions>
    <DataFileType>XLSX</DataFileType>
    <CacheValueListItems>true</CacheValueListItems>
    <RequireSourceFileForFirstDocumentObjectVersion>true</RequireSourceFileForFirstDocumentObjectVersion>
    <MaxAttemptsToFindSourceFile>0</MaxAttemptsToFindSourceFile>
    <DelayBetweenAttemptsInMillis>1000</DelayBetweenAttemptsInMillis>
    <ForceRelativePaths>false</ForceRelativePaths>
    <DelayForUserInterfaceInMillis>10</DelayForUserInterfaceInMillis>
    <ACLParameterForCreatedObjects>TypeDefaultACL</ACLParameterForCreatedObjects>
    <IncludeOriginalPathForSFDs>false</IncludeOriginalPathForSFDs>
  </GeneralOptions>
  <ErrorOptions>
    <LogFolder />
    <WriteLog>Simple</WriteLog>
    <WriteErrorFile>true</WriteErrorFile>
    <WriteResultFile>false</WriteResultFile>
    <CopyDataFiles>Never</CopyDataFiles>
    <DeleteSourceFiles>Never</DeleteSourceFiles>
    <DeleteDataFiles>Never</DeleteDataFiles>
    <WriteSystemErrorsToFile>true</WriteSystemErrorsToFile>
    <WriteSystemErrorsToWindowsApplicationLog>true</WriteSystemErrorsToWindowsApplicationLog>
    <ShowErrorDialogInSilentMode>false</ShowErrorDialogInSilentMode>
    <ErrorClassID>-1</ErrorClassID>
  </ErrorOptions>
  <MonitoringOptions>
    <MonitoredFolder />
    <MonitoredSubfoldersTextFile />
    <MonitoredSubfolderRegex />
    <MonitoringContinuously>false</MonitoringContinuously>
    <MonitoringIntervalInSeconds>60</MonitoringIntervalInSeconds>
    <MonitoringStartTime />
    <MonitoringEndTime />
  </MonitoringOptions>
  <TransmittalOptions>
    <TransmittalClassID>-1</TransmittalClassID>
    <TransmittalPropertyID>-1</TransmittalPropertyID>
    <LinkFromTransmittalToImportedObject>NoLink</LinkFromTransmittalToImportedObject>
  </TransmittalOptions>
  <DuplicateOptions>
    <EnableDuplicateDetection>true</EnableDuplicateDetection>
    <ReplaceDuplicate>Always</ReplaceDuplicate>
    <MaxAttemptsToReplaceDuplicate>2</MaxAttemptsToReplaceDuplicate>
    <DelayBetweenAttemptsInMillis>5000</DelayBetweenAttemptsInMillis>
    <AllowEmptyValuesInSearchConditions>false</AllowEmptyValuesInSearchConditions>
  </DuplicateOptions>
  <TimestampOptions>
    <GetFirstVersionCreatedAndModifiedTimestampsFromFile>true</GetFirstVersionCreatedAndModifiedTimestampsFromFile>
    <GetLaterVersionsModifiedTimestampFromFile>false</GetLaterVersionsModifiedTimestampFromFile>
    <ConvertToUTC>true</ConvertToUTC>
  </TimestampOptions>
  <MFConnectionOptions>
    <MaxAttemptsToRecreateLostConnection>0</MaxAttemptsToRecreateLostConnection>
    <DelayBetweenConnectionAttemptsInMillis>1000</DelayBetweenConnectionAttemptsInMillis>
    <RetryMFilesAPICallAfterRecreatingLostConnection>true</RetryMFilesAPICallAfterRecreatingLostConnection>
    <IsMFilesClientApplication>true</IsMFilesClientApplication>
    <ConnectInteractively>false</ConnectInteractively>
    <MFAuthenticationType>MFAuthTypeSpecificMFilesUser</MFAuthenticationType>
    <MFUsername>mfilesuser1@istar.com</MFUsername>
    <MFPassword>###CF2tdGswRyg+hQCtm8gYMzNwNDzAN1h/xZ2KaZFRPmA=</MFPassword>
    <MFDomain>istarfinancial.com</MFDomain>
    <MFProtocolSequence>ncacn_http</MFProtocolSequence>
    <MFHost>https://istar.cloudvault.m-files.com</MFHost>
    <MFPort>4466</MFPort>
    <MFLocalComputerName />
    <MFAllowAnonymousConnection>false</MFAllowAnonymousConnection>
    <MFVaultGUID>{099851CD-DF97-411A-846D-64ADEFAA5581}</MFVaultGUID>
    <MFTimeZone />
    <MFSPN />
    <MFEncryptedConnection>false</MFEncryptedConnection>
  </MFConnectionOptions>
  <CSVFileOptions>
    <CSVEncoding>windows-1252</CSVEncoding>
    <CSVSeparator>;</CSVSeparator>
    <CSVListSeparator>|</CSVListSeparator>
    <CSVQuotation>"</CSVQuotation>
    <SupportMultilineValues>false</SupportMultilineValues>
  </CSVFileOptions>
  <ExcelOptions>
    <ExcelConnectionString>Provider=Microsoft.ACE.OLEDB.12.0;Data Source={0};Extended Properties="Excel 12.0;HDR=NO;IMEX=1"</ExcelConnectionString>
    <ExcelSheetName>Sheet1$</ExcelSheetName>
    <ExcelOverwriteExistingCsvFile>false</ExcelOverwriteExistingCsvFile>
  </ExcelOptions>
  <XMLOptions>
    <XMLEncoding>UTF-8</XMLEncoding>
    <XMLListSeparator>|</XMLListSeparator>
    <XMLItemSelector />
    <XMLMustContainItems>true</XMLMustContainItems>
    <XMLMappingsMustExist>false</XMLMappingsMustExist>
    <XMLValidationFile />
  </XMLOptions>
  <FolderOptions>
    <CreateMfdFromDir>false</CreateMfdFromDir>
    <IncludeSubFolders>false</IncludeSubFolders>
    <MaxFileCountForDirectories>100</MaxFileCountForDirectories>
  </FolderOptions>
  <Mappings>
    <Mapping>
      <Description />
      <Source>Class_ID</Source>
      <ID>100</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Doc_Type_ID</Source>
      <ID>1062</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Doc_Sub_Type_ID</Source>
      <ID>1063</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Doc_Sub_Type2_ID</Source>
      <ID>1142</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Year_ID</Source>
      <ID>1091</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>File_Name</Source>
      <ID>0</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>File_Location</Source>
      <ID>-1001</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Workflow_ID</Source>
      <ID>38</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
  </Mappings>
</ToolSettings>

Reply

0 Moises over 3 years ago in reply to DCPDamon

The weird thing is that I cannot locate anything on the drive, but it does fill it up somehow.

We are moving these files to a cloud vault, not sure if that makes any difference.

Here is the XML used during that specific migration:

<?xml version="1.0" encoding="utf-8"?>
<ToolSettings xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
  <Name>Example Excel Settings for Excel Files</Name>
  <Description>This file contains example settings for M-Files Importer. It demonstrates how you can import data from an Excel file. You can test this with the Sample Vault.</Description>
  <GeneralOptions>
    <DataFileType>XLSX</DataFileType>
    <CacheValueListItems>true</CacheValueListItems>
    <RequireSourceFileForFirstDocumentObjectVersion>true</RequireSourceFileForFirstDocumentObjectVersion>
    <MaxAttemptsToFindSourceFile>0</MaxAttemptsToFindSourceFile>
    <DelayBetweenAttemptsInMillis>1000</DelayBetweenAttemptsInMillis>
    <ForceRelativePaths>false</ForceRelativePaths>
    <DelayForUserInterfaceInMillis>10</DelayForUserInterfaceInMillis>
    <ACLParameterForCreatedObjects>TypeDefaultACL</ACLParameterForCreatedObjects>
    <IncludeOriginalPathForSFDs>false</IncludeOriginalPathForSFDs>
  </GeneralOptions>
  <ErrorOptions>
    <LogFolder />
    <WriteLog>Simple</WriteLog>
    <WriteErrorFile>true</WriteErrorFile>
    <WriteResultFile>false</WriteResultFile>
    <CopyDataFiles>Never</CopyDataFiles>
    <DeleteSourceFiles>Never</DeleteSourceFiles>
    <DeleteDataFiles>Never</DeleteDataFiles>
    <WriteSystemErrorsToFile>true</WriteSystemErrorsToFile>
    <WriteSystemErrorsToWindowsApplicationLog>true</WriteSystemErrorsToWindowsApplicationLog>
    <ShowErrorDialogInSilentMode>false</ShowErrorDialogInSilentMode>
    <ErrorClassID>-1</ErrorClassID>
  </ErrorOptions>
  <MonitoringOptions>
    <MonitoredFolder />
    <MonitoredSubfoldersTextFile />
    <MonitoredSubfolderRegex />
    <MonitoringContinuously>false</MonitoringContinuously>
    <MonitoringIntervalInSeconds>60</MonitoringIntervalInSeconds>
    <MonitoringStartTime />
    <MonitoringEndTime />
  </MonitoringOptions>
  <TransmittalOptions>
    <TransmittalClassID>-1</TransmittalClassID>
    <TransmittalPropertyID>-1</TransmittalPropertyID>
    <LinkFromTransmittalToImportedObject>NoLink</LinkFromTransmittalToImportedObject>
  </TransmittalOptions>
  <DuplicateOptions>
    <EnableDuplicateDetection>true</EnableDuplicateDetection>
    <ReplaceDuplicate>Always</ReplaceDuplicate>
    <MaxAttemptsToReplaceDuplicate>2</MaxAttemptsToReplaceDuplicate>
    <DelayBetweenAttemptsInMillis>5000</DelayBetweenAttemptsInMillis>
    <AllowEmptyValuesInSearchConditions>false</AllowEmptyValuesInSearchConditions>
  </DuplicateOptions>
  <TimestampOptions>
    <GetFirstVersionCreatedAndModifiedTimestampsFromFile>true</GetFirstVersionCreatedAndModifiedTimestampsFromFile>
    <GetLaterVersionsModifiedTimestampFromFile>false</GetLaterVersionsModifiedTimestampFromFile>
    <ConvertToUTC>true</ConvertToUTC>
  </TimestampOptions>
  <MFConnectionOptions>
    <MaxAttemptsToRecreateLostConnection>0</MaxAttemptsToRecreateLostConnection>
    <DelayBetweenConnectionAttemptsInMillis>1000</DelayBetweenConnectionAttemptsInMillis>
    <RetryMFilesAPICallAfterRecreatingLostConnection>true</RetryMFilesAPICallAfterRecreatingLostConnection>
    <IsMFilesClientApplication>true</IsMFilesClientApplication>
    <ConnectInteractively>false</ConnectInteractively>
    <MFAuthenticationType>MFAuthTypeSpecificMFilesUser</MFAuthenticationType>
    <MFUsername>mfilesuser1@istar.com</MFUsername>
    <MFPassword>###CF2tdGswRyg+hQCtm8gYMzNwNDzAN1h/xZ2KaZFRPmA=</MFPassword>
    <MFDomain>istarfinancial.com</MFDomain>
    <MFProtocolSequence>ncacn_http</MFProtocolSequence>
    <MFHost>https://istar.cloudvault.m-files.com</MFHost>
    <MFPort>4466</MFPort>
    <MFLocalComputerName />
    <MFAllowAnonymousConnection>false</MFAllowAnonymousConnection>
    <MFVaultGUID>{099851CD-DF97-411A-846D-64ADEFAA5581}</MFVaultGUID>
    <MFTimeZone />
    <MFSPN />
    <MFEncryptedConnection>false</MFEncryptedConnection>
  </MFConnectionOptions>
  <CSVFileOptions>
    <CSVEncoding>windows-1252</CSVEncoding>
    <CSVSeparator>;</CSVSeparator>
    <CSVListSeparator>|</CSVListSeparator>
    <CSVQuotation>"</CSVQuotation>
    <SupportMultilineValues>false</SupportMultilineValues>
  </CSVFileOptions>
  <ExcelOptions>
    <ExcelConnectionString>Provider=Microsoft.ACE.OLEDB.12.0;Data Source={0};Extended Properties="Excel 12.0;HDR=NO;IMEX=1"</ExcelConnectionString>
    <ExcelSheetName>Sheet1$</ExcelSheetName>
    <ExcelOverwriteExistingCsvFile>false</ExcelOverwriteExistingCsvFile>
  </ExcelOptions>
  <XMLOptions>
    <XMLEncoding>UTF-8</XMLEncoding>
    <XMLListSeparator>|</XMLListSeparator>
    <XMLItemSelector />
    <XMLMustContainItems>true</XMLMustContainItems>
    <XMLMappingsMustExist>false</XMLMappingsMustExist>
    <XMLValidationFile />
  </XMLOptions>
  <FolderOptions>
    <CreateMfdFromDir>false</CreateMfdFromDir>
    <IncludeSubFolders>false</IncludeSubFolders>
    <MaxFileCountForDirectories>100</MaxFileCountForDirectories>
  </FolderOptions>
  <Mappings>
    <Mapping>
      <Description />
      <Source>Class_ID</Source>
      <ID>100</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Doc_Type_ID</Source>
      <ID>1062</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Doc_Sub_Type_ID</Source>
      <ID>1063</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Doc_Sub_Type2_ID</Source>
      <ID>1142</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Year_ID</Source>
      <ID>1091</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>File_Name</Source>
      <ID>0</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>File_Location</Source>
      <ID>-1001</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
    <Mapping>
      <Description />
      <Source>Workflow_ID</Source>
      <ID>38</ID>
      <FixedValue />
      <Duplicate>false</Duplicate>
      <CanSetEmpty>false</CanSetEmpty>
      <ValueListOptions>
        <Mode>NameOrInternalID</Mode>
        <CreateNewValueListItems>false</CreateNewValueListItems>
        <MustExist>true</MustExist>
      </ValueListOptions>
    </Mapping>
  </Mappings>
</ToolSettings>

Children

No Data

Mass Migration Using Importer

Top Replies

Contact Us

Schedule a Demo

Careers

Trust Center

Privacy Policy

Security Hall of Fame

Subcontractors

M-Files Community

Support Portal

Help Center

Product Center

Download M-Files

User Guides

Product News