Description

Index documents are submitted to a Solr server in XML format. Third-party media content extractors might produce characters that cannot be converted to XML. As a result, the entire documents batch cannot be indexed. Errors similar to the following can be found in log records:

Exception: System.ArgumentException
Message: '◻', hexadecimal value 0x1F, is an invalid character.
Source: System.Xml
   at System.Xml.XmlEncodedRawTextWriter.WriteElementTextBlock(Char* pSrc, Char* pSrcEnd)
   at System.Xml.XmlEncodedRawTextWriter.WriteString(String text)
   at System.Xml.XmlWellFormedWriter.WriteString(String text)
   at System.Xml.Linq.ElementWriter.WriteElement(XElement e)
   at System.Xml.Linq.XElement.WriteTo(XmlWriter writer)
   at System.Xml.Linq.XNode.GetXmlString(SaveOptions o)
   at SolrNet.Commands.AddCommand`1.ConvertToXml()
   at SolrNet.Commands.AddCommand`1.Execute(ISolrConnection connection)
   at SolrNet.Impl.LowLevelSolrServer.SendAndParseHeader(ISolrCommand cmd)
   at Sitecore.ContentSearch.SolrProvider.SolrBatchUpdateContext.AddRange(IEnumerable`1 group, Int32 groupSize)
   at Sitecore.ContentSearch.SolrProvider.SolrBatchUpdateContext.Commit()
   at Sitecore.ContentSearch.AbstractSearchIndex.PerformUpdate(IEnumerable`1 indexableInfo, IndexingOptions indexingOptions)
   at Sitecore.ContentSearch.AbstractSearchIndex.Update(IEnumerable`1 indexableInfo)

Job started: Index_Update_IndexName=sitecore_web_index|#Exception: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.ArgumentException: '.', hexadecimal value 0x00, is an invalid character.
   at System.Xml.XmlEncodedRawTextWriter.WriteElementTextBlock(Char* pSrc, Char* pSrcEnd)
   at System.Xml.XmlEncodedRawTextWriter.WriteString(String text)
   at System.Xml.XmlWellFormedWriter.WriteString(String text)
   at System.Xml.Linq.ElementWriter.WriteElement(XElement e)
   at System.Xml.Linq.XElement.WriteTo(XmlWriter writer)
   at System.Xml.Linq.XNode.GetXmlString(SaveOptions o)
   at SolrNet.Commands.AddCommand`1.ConvertToXml()
   at SolrNet.Commands.AddCommand`1.Execute(ISolrConnection connection)
   at SolrNet.Impl.LowLevelSolrServer.SendAndParseHeader(ISolrCommand cmd)
   at Sitecore.ContentSearch.SolrProvider.SolrBatchUpdateContext.AddRange(IEnumerable`1 group, Int32 groupSize)
   at Sitecore.ContentSearch.SolrProvider.SolrBatchUpdateContext.Commit()
   at Sitecore.ContentSearch.SolrProvider.SolrSearchIndex.PerformRebuild(Boolean resetIndex, Boolean optimizeOnComplete, IndexingOptions indexingOptions, CancellationToken cancellationToken)
   at Sitecore.ContentSearch.SolrProvider.SolrSearchIndex.Rebuild(Boolean resetIndex, Boolean optimizeOnComplete) 

Solution

To resolve the issue, consider one of the following solutions compatible with the affected product version:

• For Sitecore XP 9.3:
  
  1. Verify that the Sitecore.ContentSearch.SolrProvider.dll assembly version matches 6.0.0-r00353.3573 (right-click on the file, click Properties, then Details, and select the Product version property).
  2. Download and install the following hotfix: SC Hotfix 434248-2.zip
  Contact Sitecore Support if the assembly version does not match the default version.
• For Sitecore XP 9.2:
  
  1. Verify that the Sitecore.ContentSearch.SolrProvider.dll assembly version matches 5.0.0-r00290 (right-click on the file, click Properties, then Details, check the Product version property).
  2. Download and install the following hotfix: SC Hotfix 380817-1.zip
  Contact Sitecore Support if the assembly version does not match the default version.
• For Sitecore XP 9.1.1 and earlier: Currently, there is no solution for these versions. We recommend upgrading to a newer Sitecore XP version. There are a number of mitigation options that can be used if an upgrade is not possible at the moment:
  
  • Option 1 (if searching through the content of media files is not used in your solution):
    
    • For Sitecore XP 9.0.0 and later:
      Disable Media Indexing using a configuration file: Sitecore.Support.DisableMediaIndexing.config
    • For Sitecore CMS 7.2 — Sitecore XP 8.2.7:
      
      • Solr provider: Sitecore.Support.DisableMediaIndexing.config
      • Azure Search provider: Sitecore.Support.DisableMediaIndexing.config
      • Lucene provider: Sitecore.Support.DisableMediaIndexing.config
    • For Sitecore CMS 7.1 and earlier:
      Contact Sitecore Support for instructions.
  • Option 2 (if the solution is not hosted in Azure Web Apps):
    Try switching to a different third-party media content extraction implementation.
    • For Sitecore XP 9.1.1:
      
      1. Update the Sitecore XP configuration as described here.
      2. Install a third-party iFilter for PDF content extraction.
    • For Sitecore XP 9.1.0:
      
      1. Verify that the Sitecore.ContentSearch.dll assembly version matches 4.0.0-r00230 (right-click on the file, click Properties, then Details, and select the Product version property).
      2. Download and install this hotfix: SC Hotfix 305412-1.zip
         The hotfix allows using iFilter for PDF content extraction. Content extraction for DOCX, PPTX, and XLSX files is disabled.
      3. Install a third-party iFilter for PDF content extraction.
      Contact Sitecore Support for an alternative solution if the assembly version does not match the default version.
    • For Sitecore XP 9.0.2 and earlier:
      Try changing the iFilters that are used for media content extraction.
  • Option 3 (if nothing helps):
    Contact Sitecore Support. Describe the options you tried and the reason these options do not work for your solution.