full_search by date_modified failing for very large project with Java heap space I-Server Error ERR001

[hustontrevor]

Project has over 30k objects. Only 250 modified in the desired range.
modified = full_search(connection=source_conn,project=prj,name='',date_modified='>=2023-09-01')

Connection to MicroStrategy Intelligence Server has been established.
Error getting search result for search with ID DA0CF8AE814B05C83C06699CC9FEDA31
I-Server Error ERR001, Java heap space
Ticket ID: 1b082734a30541e6b3062b96e71a39bb
Connection to MicroStrategy Intelligence Server has been closed.

Traceback (most recent call last):
File "c:\Users\u68398\Desktop\MicroStrategy GitLab\automation\Python_Mstrio_REST\hwpy\mstrio\ServerUpgrade_Package_All_Project_by_ModDate.py", line 185, in
main()
File "c:\Users\u68398\Desktop\MicroStrategy GitLab\automation\Python_Mstrio_REST\hwpy\mstrio\ServerUpgrade_Package_All_Project_by_ModDate.py", line 83, in main
modified = full_search(connection=source_conn,project=prj,name='',date_modified=searchValue)
File "c:\Users\u68398\Desktop\MicroStrategy GitLab\automation\Python_Mstrio_REST.venv\lib\sitepackages\mstrio\utils\version_helper.py", line 41, in inner
return function(*args, **kwargs)
File "c:\Users\u68398\Desktop\MicroStrategy GitLab\automation\Python_Mstrio_REST.venv\lib\sitepackages\mstrio\object_management\search_operations.py", line 366, in full_search
return get_search_results(**search_result_params)
File "c:\Users\u68398\Desktop\MicroStrategy GitLab\automation\Python_Mstrio_REST.venv\lib\sitepackages\mstrio\utils\version_helper.py", line 41, in inner
return function(*args, **kwargs)
File "c:\Users\u68398\Desktop\MicroStrategy GitLab\automation\Python_Mstrio_REST.venv\lib\sitepackages\mstrio\object_management\search_operations.py", line 538, in get_search_results
return _get_search_result_list_format(**get_result_params)
File "c:\Users\u68398\Desktop\MicroStrategy GitLab\automation\Python_Mstrio_REST.venv\lib\sitepackages\mstrio\object_management\search_operations.py", line 552, in _get_search_result_list_format
response = browsing.get_search_results(
File "c:\Users\u68398\Desktop\MicroStrategy GitLab\automation\Python_Mstrio_REST.venv\lib\sitepackages\mstrio\utils\error_handlers.py", line 61, in inner
response_handler(response, error_msg, **handler_kwargs)
File "c:\Users\u68398\Desktop\MicroStrategy GitLab\automation\Python_Mstrio_REST.venv\lib\sitepackages\mstrio\utils\helper.py", line 255, in response_handler
raise IServerError(
mstrio.helpers.IServerError: Java heap space; code: 'ERR001', ticket_id: '1b082734a30541e6b3062b96e71a39bb'

[urszulajaczewska]

Hi @hustontrevor, we've logged a defect for it and we'll investigate the issue.

[hustontrevor]

If anyone needs a workaround for this, I cheated and just queried the metadata database directly. The Platform_Analytics lu_objects table is another option, but it's a messy list that needs lots of filtering.

        sql = f'''SELECT p.OBJECT_NAME project_name ,o.OBJECT_ID id ,o.OBJECT_TYPE type 
                FROM {schema}.DSSMDOBJINFO o JOIN {schema}.DSSMDOBJINFO p on p.OBJECT_ID = o.PROJECT_ID
                WHERE o.mod_time >= to_date({sqlsearchValue},'YYYY-MM-DD') 
                    and o.object_name <> 'Managed Objects' 
                    and o.object_type not in (75) '''

[mgorskiMicroStrategy]

Hi @hustontrevor
This issue should be solved with the latest Microstrategy One March 2024 release
Error message was improved also full_search has new parameters begin_modification_time and end_modification_time that will give possibility to filter results on server side